-- Logs begin at Mon 2022-08-29 21:48:27 UTC, end at Mon 2022-08-29 23:07:57 UTC. -- Aug 29 22:39:27.052852 dv-cinder-854269-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 22:39:27.063144 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:39:27 2022] *** Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: nodename: dv-cinder-854269-4-iscsi Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: machine: x86_64 Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: clock source: unix Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: pcre jit disabled Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: detected number of CPU cores: 4 Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: current working directory: / Aug 29 22:39:27.065169 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:39:27.066478 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: your processes number limit is 47680 Aug 29 22:39:27.066478 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: your memory page size is 4096 bytes Aug 29 22:39:27.066478 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: detected max file descriptor number: 2048 Aug 29 22:39:27.066478 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: lock engine: pthread robust mutexes Aug 29 22:39:27.066478 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: thunder lock: enabled Aug 29 22:39:27.066478 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 22:39:27.066478 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:39:27.110517 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: Python main interpreter initialized at 0x55de316bb9c0 Aug 29 22:39:27.110517 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: python threads support enabled Aug 29 22:39:27.110517 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: your server socket listen backlog is limited to 100 connections Aug 29 22:39:27.110517 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:39:27.110935 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:39:27.110935 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: *** Operational MODE: preforking *** Aug 29 22:39:27.111189 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:39:27.111189 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: spawned uWSGI master process (pid: 124030) Aug 29 22:39:27.111400 dv-cinder-854269-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 22:39:27.112148 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: spawned uWSGI worker 1 (pid: 124031, cores: 1) Aug 29 22:39:27.115933 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: spawned uWSGI worker 2 (pid: 124032, cores: 1) Aug 29 22:39:27.115933 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:39:27.777614 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:39:27.791599 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:39:28.863281 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:39:28.863281 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: from cryptography.utils import int_from_bytes Aug 29 22:39:28.863861 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:39:28.863861 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: from cryptography.utils import int_from_bytes Aug 29 22:39:28.865165 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:39:28.865165 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: from cryptography.utils import int_from_bytes Aug 29 22:39:28.865593 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:39:28.865593 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: from cryptography.utils import int_from_bytes Aug 29 22:39:31.361760 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:39:31.362360 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:39:31.362537 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:39:31.362733 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:39:31.363100 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:39:31.363200 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:39:31.363290 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:39:31.363496 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.363602 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:39:31.363814 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.363915 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:39:31.364100 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:39:31.364185 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.364433 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.364520 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.364783 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.364885 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.365096 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.365513 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.365611 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.365691 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.365782 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.365880 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.366021 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.366116 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.366276 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.366372 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.366586 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.366683 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.366948 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-4-iscsi {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.367078 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.367319 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.367415 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.367622 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.367709 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.367928 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.368013 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-4-iscsi {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.368242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.368340 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.368543 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.368629 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.368884 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.368973 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.369187 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.369280 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.369510 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.369687 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.369837 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.370138 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.370260 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.370442 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.370652 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.370755 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.370961 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.371075 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.371272 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.371374 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.371585 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.371670 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.371925 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.372021 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.372242 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.372348 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.372554 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.372640 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.372883 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.373006 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.373200 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.373283 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-4-iscsi {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.373527 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.373650 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.373839 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.373938 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.374167 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.374301 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-4-iscsi {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.374541 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.374631 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.374860 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.374956 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.375163 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.375258 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.375481 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.375613 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.375801 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.375898 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.376105 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.376193 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.376429 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.376520 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.376762 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.376852 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.377081 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.377179 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.377395 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.377494 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.377694 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.377786 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.377997 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.378095 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.378301 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.378395 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.378616 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.378712 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.378916 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.379008 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.379217 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.379311 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.379463 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.379548 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.379766 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.379858 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.380085 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.380173 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.380377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.380460 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.380688 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.380813 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.380964 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.381188 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.381333 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.381475 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.381663 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.381778 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.381983 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.382829 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.383135 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.383307 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.383441 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.383749 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.384052 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.384354 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.384448 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.384657 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.384793 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.384987 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.385130 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.385304 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.385432 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.385619 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.385750 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.385936 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.386065 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.386241 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.386381 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.386557 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.386693 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.386948 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.387034 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.387196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.387288 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.387499 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.387668 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.387834 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.387927 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.388150 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.388242 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.388457 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.388544 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.388794 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.388884 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.389114 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.389201 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.389417 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.389542 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.389718 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.389809 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.390022 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.390107 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.390338 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.390425 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.390667 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.390752 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.390967 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.391063 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.391214 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.391346 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.391515 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.391672 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.391813 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.391985 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.392128 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.392297 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.392429 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.392607 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.392760 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.392956 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.393079 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.393305 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.393396 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.393591 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.393677 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.393844 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.393930 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.394149 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.394234 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.394459 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.394545 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.394783 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.394883 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.395087 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.395172 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.395390 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.395475 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.395690 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.395777 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.395987 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.396073 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.396293 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.396384 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.396601 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.396687 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.396930 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.397051 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.397234 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.397337 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.397535 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.397640 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.397836 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.397923 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.398753 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.398927 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.399055 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.399172 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.399366 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.399451 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.399689 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.399787 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.399995 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.400088 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.400298 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.400384 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.400605 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.400702 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.400933 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.401018 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.401237 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.401370 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.401558 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.401687 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.401860 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.402064 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.402225 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.402378 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.402527 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.402686 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.402832 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.402974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.403132 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.403298 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.403440 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.403601 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.403763 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.403908 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404045 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404186 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404315 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404402 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404556 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404682 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404892 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.404982 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.405216 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.405305 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.405528 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.405614 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.405838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.405924 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.406146 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.406232 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.406452 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.406535 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.406749 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.406831 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.407056 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.407138 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.407363 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.407439 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.407671 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.407759 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.407968 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.408072 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.408287 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.408379 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.408611 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.408708 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.408945 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.409040 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.409255 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.409348 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.409561 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.409660 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.409870 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.409955 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:39:31.410192 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.410277 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.410498 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.410598 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.410804 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.410889 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.411166 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.411386 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.411487 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.411699 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.411823 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.412061 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.412270 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.412342 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.412444 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.412749 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.412869 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.412972 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.413103 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.413280 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.413505 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.413604 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.413769 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.413905 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.414182 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.414354 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.414452 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.414741 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.414927 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.415073 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.415394 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.415481 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.415713 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.416034 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.416119 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.416348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.416668 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.416803 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.417025 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.417302 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.417400 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.417648 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.417993 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.418087 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.418345 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.418431 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.418664 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.418749 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.418994 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.419087 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.419308 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.419402 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.419621 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.419706 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.419935 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.420048 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.420245 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.420338 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.420562 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.420649 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.420910 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.421011 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.421230 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.421322 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.421538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.421630 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.421847 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.421935 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.422178 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.422317 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.422469 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.422555 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.422775 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.422870 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.423086 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.423172 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.423401 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.423525 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.423714 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.423803 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.424025 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.424109 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.424333 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.424422 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.424646 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.424763 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.424979 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.425077 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.425285 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.425373 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.425590 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.425684 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.425891 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.425986 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.426191 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.426287 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.426491 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.426578 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.426794 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.426887 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.427095 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.427190 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.427410 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.427497 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.427730 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.427817 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.428033 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.428127 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.428353 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.428439 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.428653 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.428758 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.429016 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.429768 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.429870 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.430164 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.430164 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.430365 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.430507 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.430797 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.430885 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.431116 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.431208 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.431419 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.431514 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.431739 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.431823 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.432044 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.432129 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.432353 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.432453 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.432663 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.432776 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.432991 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.433079 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.433294 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.433392 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.433605 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.433693 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.433914 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.434001 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.434225 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.434356 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.434531 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.434618 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.434841 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.434935 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.435153 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.435241 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.435457 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.435542 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.435763 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.435849 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.436077 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.436164 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.436404 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.436489 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.436704 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.436826 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.437049 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.437135 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.437621 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.437722 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.437934 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.438029 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.438234 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.438329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.438540 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.438627 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.438841 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.438936 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.439142 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.439229 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.439440 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.439526 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.439745 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.439912 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.440045 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.440132 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.440343 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.440430 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.440644 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.440789 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.440967 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.441065 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.441269 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.441356 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.441587 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.441683 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.441891 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.441976 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.442193 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.442278 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.442492 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.442580 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.442793 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.442887 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.443117 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.443201 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.443417 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.443503 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.443724 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.443817 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.444034 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.444127 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.444367 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.444452 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.444675 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.444778 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.445616 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.445724 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.445890 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.446169 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.446307 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.446474 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.446599 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.446780 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.446936 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.447086 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.447259 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.447401 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.447587 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.447709 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.447907 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.448023 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.448227 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.448321 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.448546 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.448641 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.448888 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.448976 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.449216 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.449304 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.449535 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.449622 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.449853 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.449944 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.450168 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.450307 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.450497 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.450605 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.450805 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.450890 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.451126 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.451211 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.451441 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.451529 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.451765 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.451880 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.452109 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.452195 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.452423 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.452518 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.452768 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.452877 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.453055 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.453142 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.453370 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.453456 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.453676 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.453762 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.453989 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.454092 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.454294 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.454389 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.454611 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.454704 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.454913 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.455025 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.455227 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.455314 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.455528 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.455615 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.455837 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.455979 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.456149 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.456234 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.456475 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.456568 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.456871 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.456980 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.457183 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.457269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.457496 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.457581 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.457800 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.457893 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.458106 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.458192 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.458412 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.458508 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.458713 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.458808 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.459013 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.459107 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.459320 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.459407 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.459632 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.459719 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.459937 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.460031 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.460244 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.460330 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.460606 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.460759 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.460942 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.461208 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.461295 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.461535 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.461629 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.461834 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.461929 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.462142 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.462228 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.462459 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.462545 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.462769 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.462898 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.463086 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.463174 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.463400 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.463486 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.463701 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.463795 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.464004 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.464098 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.464316 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.464401 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.464620 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.464736 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.464944 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.465032 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.465246 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.465332 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.465546 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.465631 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.465885 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.465996 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.466193 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.466289 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.466491 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.466579 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.466804 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.466899 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.467113 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.467199 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.467416 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.467501 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.467721 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.467814 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.468024 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.468116 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.468330 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.468428 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.468647 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.468763 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.468983 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.469080 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.469288 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.469375 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.469595 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.469684 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.469902 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.469988 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.470208 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.470294 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.470513 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.470600 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.470830 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.470917 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.471135 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.471222 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.471440 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.471527 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.471745 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.471875 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.472043 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.472130 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.472353 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.472441 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.472665 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.472780 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.473020 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.473262 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.473357 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.473594 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.473681 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.473909 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.474001 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.474226 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.474386 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.474538 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.474713 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.474857 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.475061 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.475389 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.475489 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.475715 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.475800 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.476026 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.476168 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.476366 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.476473 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.476673 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.476783 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.477008 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.477118 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.477305 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.477440 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.477612 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.477771 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.477916 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.478090 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.478217 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.478400 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.478517 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.478713 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.478823 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.479023 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.479108 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.479331 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.479424 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.479645 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.479738 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.479953 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.480052 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.480261 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.480346 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.480558 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.480642 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.480889 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.480977 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.481192 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.481279 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.481498 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.481582 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.481800 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.481903 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.482101 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.482188 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.482404 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.482489 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.482702 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.482800 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.483018 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.483135 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.483324 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.483422 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.483650 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.483746 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.483962 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.484077 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.484271 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.484365 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.484577 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.484672 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.484905 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.485003 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.485229 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.485332 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.485529 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.485630 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.485829 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.485923 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.486128 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.486215 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.486433 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.486521 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.486739 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.486833 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.487038 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.487125 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.487346 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.487434 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.487649 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.487736 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.487954 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.488040 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.488258 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.488346 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.488557 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.488650 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.488900 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.488988 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.489202 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.489290 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.489513 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.489607 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.489818 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.489913 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.490117 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.490203 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.490416 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.490510 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.490723 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.490821 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.491028 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.491114 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.491329 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.491417 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.491635 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.492284 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.492463 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.492557 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.492823 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.492942 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.493129 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.493290 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.493474 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.493617 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.493782 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.493916 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.494130 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.494229 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.494388 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.494524 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.494660 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.494801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.494962 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.495104 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.495266 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.495404 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.495565 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.495698 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.495867 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.496011 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.496171 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.496312 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.496472 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.496604 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.496802 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.496892 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.497108 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.497194 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.497428 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.497525 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.497740 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.497826 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.498038 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.498132 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.498342 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.498442 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.498644 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.498731 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.498942 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.499028 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.499241 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.499337 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.499546 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.499632 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.499843 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.499929 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.500140 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.500237 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.500436 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.500522 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.500754 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.500882 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.501057 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.501146 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.501370 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.501454 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.501671 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.501756 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.501972 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.502058 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.502275 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.502362 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.502573 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.502666 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.502876 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.502961 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.503182 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.503283 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.503509 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.503603 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.503820 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.503907 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.504124 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.504215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.504437 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.504533 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.504756 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.504846 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.505070 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.505220 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.505364 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.505509 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.505644 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.505785 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.505958 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.506102 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.506264 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.506408 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.506573 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.506704 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.506872 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.507004 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.507169 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.507308 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.508011 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.508308 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.508463 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.508613 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.508708 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.508957 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.509044 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.509273 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.509367 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.509589 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.509682 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.509887 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.509972 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.510194 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.510280 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.510501 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.510595 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.510806 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.510892 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.511110 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.511196 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.511416 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.511515 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.511722 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.511809 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.512028 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.512121 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.512341 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.512499 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.512647 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.512756 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.512982 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.513070 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.513285 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.513428 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.513589 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.513676 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.513895 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.513982 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.514197 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.514285 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.514510 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.514595 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.514813 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.514897 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.515114 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.515246 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.515419 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.515506 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.515717 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.515803 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.516023 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.516110 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.516323 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.516409 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.516629 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.516787 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.516981 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.517067 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.517293 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.517386 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.517600 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.517695 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.517915 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.518003 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.518224 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.518310 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.518540 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.518634 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.518850 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.518936 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.519152 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.519286 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.519568 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.519663 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.519878 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.519965 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.520188 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.520273 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.520498 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.520585 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.520835 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.520987 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.521135 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.521221 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.521441 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.521519 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.521752 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.521846 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.522053 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.522172 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.522359 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.522492 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.522660 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.522810 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.523067 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.523201 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.523387 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.523691 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.523787 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.524007 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.524094 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.524327 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.524422 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.524661 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.524772 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.525001 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.525114 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.525312 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.525407 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.525623 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.525709 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.525955 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.526050 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.526266 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.526352 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.526593 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.526685 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.526922 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.527017 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.527232 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.527326 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.527537 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.527634 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.527860 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.528022 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.528183 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.528339 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.528492 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.528655 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.528830 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.529011 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.529135 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.529341 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.529454 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.529677 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.529765 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.529989 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.530075 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.530309 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.530397 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.530624 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.530773 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.530953 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.531095 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.531284 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.531401 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.531601 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.531719 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.531922 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.532041 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.532235 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.532360 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.532563 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.532682 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.532915 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.533044 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.533235 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.533359 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.533606 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.533741 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.533872 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.534070 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.534181 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.534307 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.534475 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.534591 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.534784 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.534909 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.535115 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.535244 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.535391 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.535506 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.535692 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.535818 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.536011 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.536127 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.536313 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.536430 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.536616 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.536765 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.537482 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.537611 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.537709 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.537804 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.537894 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.537976 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538055 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538139 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538229 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538319 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538468 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538554 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538799 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.538907 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.539100 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.539230 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.539404 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.539522 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.539747 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.539862 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.540050 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.540179 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.540366 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.540481 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.540698 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.540849 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.541049 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.541166 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.541358 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.541472 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.543776 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.543906 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544009 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544095 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544095 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544260 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544341 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544420 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544420 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544575 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544655 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544823 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.544909 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545003 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545085 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545164 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545290 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545388 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545470 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545558 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545639 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545719 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545799 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545877 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.545963 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546052 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546139 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546219 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546298 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546376 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546462 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546551 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546631 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546717 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546797 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.546949 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.547045 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.547258 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.547345 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.547567 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.547652 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.547864 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.547958 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.548174 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.548267 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.548482 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.548575 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.548822 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.548926 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.549128 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.549214 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.549449 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.549536 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.549755 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.549853 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.550064 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.550157 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.550375 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.550462 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.550682 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.550821 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.550988 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.551084 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.551292 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.551378 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.551600 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.551687 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.551917 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.552028 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.552254 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.552360 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.552565 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.552654 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.552936 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.553026 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.553260 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.553486 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.553587 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.553817 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.553911 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.554131 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.554741 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.554965 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.555153 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.555351 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.555478 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.555673 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.555802 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.555984 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.556117 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.556294 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.556437 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.556603 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.556777 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.556936 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.557100 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.557310 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.557570 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.557657 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.557889 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.557986 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.558212 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.558300 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.558547 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.558634 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.558861 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.558956 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.559174 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.559263 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.559485 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.559573 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.559796 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.559883 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.560110 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.560195 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.560428 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.560533 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.560758 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.560881 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.561074 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.561176 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.561386 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.561494 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.561696 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.561792 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.562003 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.562099 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.562567 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.562694 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.562877 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.562975 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.563187 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.563291 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.563496 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.563600 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.563804 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.563891 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.564112 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.564202 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.564420 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.564509 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.564755 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.564847 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.565089 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.565194 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.565405 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.565536 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.565715 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.565803 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.566026 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.566120 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.566335 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.566420 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.566649 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.566844 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.566965 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.567155 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.567279 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.567486 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.567585 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.567807 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.567905 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.568126 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.568214 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.568437 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.568531 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.568765 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.568867 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.569091 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.569181 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.569397 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.569483 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.569698 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.569793 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.570668 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.570841 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.570980 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.571161 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.571286 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.571500 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.571608 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.571830 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.571916 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.572159 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.572255 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.572480 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.572565 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.572818 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.572954 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.573149 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.573348 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.573460 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.573696 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.573783 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.574011 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.574146 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.574333 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.574421 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.574653 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.574747 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.574967 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.575053 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.575278 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.575411 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.575587 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.575740 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.575912 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.576044 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.576226 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.576349 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.576660 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.576798 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.576995 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.577127 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.577299 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.577450 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.577605 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.577783 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.577909 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.578114 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.578203 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.578436 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.578530 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.578747 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.578840 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.579081 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.579182 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.579395 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.579503 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.579693 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.579788 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.579996 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.580082 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.580297 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.580384 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.580605 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.580733 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.580929 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.581023 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.581231 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.581317 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.581533 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.581633 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.581834 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.581921 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.582142 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.582228 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.582450 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.582544 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.582756 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.582840 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.583057 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.583152 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.583364 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.583451 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.583665 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.583750 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.583970 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.584045 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.584277 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.584381 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.584584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.584670 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.584938 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.585026 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.585253 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.585350 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.585639 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.585764 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.585950 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.586107 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.586401 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.586490 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.586715 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.586803 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.587026 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.587127 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.587331 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.587425 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.587645 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.587731 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.588003 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.588185 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.588331 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.588517 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.588639 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.588863 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.588978 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.589197 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.589293 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.589528 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.589615 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.589836 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.589930 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.590140 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.590234 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.590444 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.590531 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.590768 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.590885 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.591075 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.591179 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.591383 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.591671 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.591766 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.591986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.592089 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.592298 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.592393 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.592606 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.592701 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.592939 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.593038 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.593247 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.593342 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.593553 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.593649 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.593862 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.593951 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.594169 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.594271 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.594479 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.594585 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.594785 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.594872 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.595092 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.595179 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.595401 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.595496 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.595732 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.595816 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.596032 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.596129 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.596347 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.596446 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.596659 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.596772 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.596998 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.597096 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.597306 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.597399 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.597614 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.597701 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.597922 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.598009 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.598230 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.598317 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.598541 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.598626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.598866 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.598959 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.599178 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.599590 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.599682 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.599752 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.599819 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.599896 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.600133 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.600231 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.600453 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.600539 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.600790 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.600894 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.601137 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.601289 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.601444 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.601699 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.601787 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.602035 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.602124 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.602349 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.602442 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.602676 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.602772 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.602981 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.603065 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.603306 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.603407 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.603642 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.603738 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.603967 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.604054 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.604288 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.604375 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.604592 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.604689 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.604921 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.605009 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.605223 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.605321 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.605530 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.605618 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.605844 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.605978 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.606150 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.606239 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.606449 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.606537 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.606749 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.606835 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.607054 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.607148 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.607353 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.607465 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.607652 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.607778 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.607951 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.608087 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.608250 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.608436 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.608625 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.608780 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.608950 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.609105 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.609251 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.609419 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.609550 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.609746 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.609836 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.610040 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.610145 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.610352 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.610439 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.610661 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.610746 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.610973 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.611113 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.611281 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.611367 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.611576 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.611662 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.611921 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.612016 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.612175 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.612261 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.612479 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.612577 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.612808 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.612899 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.613119 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.613205 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.613427 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.613530 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.613734 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.613820 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.614045 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.614130 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.614348 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.614440 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.614652 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.614738 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.614959 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.615052 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.615270 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.615380 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.615574 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.615660 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.615896 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.615997 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.616205 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.616324 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.616508 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.616604 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.617359 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.617466 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.617733 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.617827 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.618065 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.618152 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.618373 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.618461 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.618695 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.618783 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.619017 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.619104 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.619320 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.619416 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.619640 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.619727 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.619953 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.620038 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.620271 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.620367 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.620583 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.620669 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.620913 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.621002 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.621243 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.621352 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.621551 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.621652 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.621859 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.621946 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.622167 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.622256 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.622472 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.622567 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.622779 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.622868 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.623097 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.623195 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.623405 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.623502 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.623712 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.623801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.624023 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.624111 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.624335 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.624421 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.624657 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.624791 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.625000 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.625098 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.625303 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.625390 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.625618 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.625717 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.625936 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.626030 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.626258 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.626382 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.626576 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.626723 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.626887 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.627017 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.627201 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.627339 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.627518 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.627656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.627826 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.627956 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.628127 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.628259 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.628400 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124032) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:39:31.628535 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.628797 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.629137 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.629467 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.629818 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.630138 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.630482 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.630818 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.631138 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.631453 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.631794 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:39:31.632004 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124031) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:39:31.784603 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO dbcounter [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Registered counter for database nova_api Aug 29 22:39:31.796386 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO dbcounter [None req-10137353-6b05-4957-8185-4c204956398d None None] Registered counter for database nova_api Aug 29 22:39:31.813563 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_db.sqlalchemy.engines [None req-10137353-6b05-4957-8185-4c204956398d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:31.815289 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_db.sqlalchemy.engines [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:31.820674 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writer thread running {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:31.822537 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writer thread running {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:31.880610 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.context [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37ab55e6-25c4-43ef-ae71-f79d8c00054c(cell1) {{(pid=124032) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:39:31.880818 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.context [None req-10137353-6b05-4957-8185-4c204956398d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37ab55e6-25c4-43ef-ae71-f79d8c00054c(cell1) {{(pid=124031) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:39:31.884421 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:31.884809 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_concurrency.lockutils [None req-10137353-6b05-4957-8185-4c204956398d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:31.884934 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:31.885288 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_concurrency.lockutils [None req-10137353-6b05-4957-8185-4c204956398d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:31.886482 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:31.886850 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_concurrency.lockutils [None req-10137353-6b05-4957-8185-4c204956398d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:31.887211 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:31.887584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_concurrency.lockutils [None req-10137353-6b05-4957-8185-4c204956398d None None] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:39:31.887673 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:31.888030 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_concurrency.lockutils [None req-10137353-6b05-4957-8185-4c204956398d None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:39:31.889642 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:31.890049 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_concurrency.lockutils [None req-10137353-6b05-4957-8185-4c204956398d None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124031) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:39:31.891592 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO dbcounter [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Registered counter for database nova_cell0 Aug 29 22:39:31.892031 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO dbcounter [None req-10137353-6b05-4957-8185-4c204956398d None None] Registered counter for database nova_cell0 Aug 29 22:39:31.895764 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO dbcounter [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Registered counter for database nova_cell1 Aug 29 22:39:31.897467 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO dbcounter [None req-10137353-6b05-4957-8185-4c204956398d None None] Registered counter for database nova_cell1 Aug 29 22:39:31.903235 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_db.sqlalchemy.engines [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:31.905543 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_db.sqlalchemy.engines [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:31.906229 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_db.sqlalchemy.engines [None req-10137353-6b05-4957-8185-4c204956398d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:31.907817 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_db.sqlalchemy.engines [None req-10137353-6b05-4957-8185-4c204956398d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:31.912243 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writer thread running {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:31.912591 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writer thread running {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:31.914465 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writer thread running {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:31.916266 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writer thread running {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:32.059122 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO dbcounter [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Registered counter for database nova_cell0 Aug 29 22:39:32.063593 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO dbcounter [None req-10137353-6b05-4957-8185-4c204956398d None None] Registered counter for database nova_cell0 Aug 29 22:39:32.068216 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_db.sqlalchemy.engines [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124032) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:32.072846 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG oslo_db.sqlalchemy.engines [None req-10137353-6b05-4957-8185-4c204956398d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124031) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:39:32.074310 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writer thread running {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:32.077271 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writer thread running {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:39:32.495478 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: WARNING keystonemiddleware.auth_token [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:39:32.502821 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: WARNING keystonemiddleware.auth_token [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:39:32.511822 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: WARNING keystonemiddleware.auth_token [None req-10137353-6b05-4957-8185-4c204956398d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:39:32.519165 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: WARNING keystonemiddleware.auth_token [None req-10137353-6b05-4957-8185-4c204956398d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:39:32.860319 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: WARNING keystonemiddleware.auth_token [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:39:32.866310 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: WARNING keystonemiddleware.auth_token [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:39:32.869030 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: WARNING keystonemiddleware.auth_token [None req-10137353-6b05-4957-8185-4c204956398d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:39:32.872335 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de316bb9c0 pid: 124032 (default app) Aug 29 22:39:32.874460 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:39:32.874958 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: WARNING keystonemiddleware.auth_token [None req-10137353-6b05-4957-8185-4c204956398d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:39:32.875652 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] 10.222.0.52 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001743 Aug 29 22:39:32.876063 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 788 bytes} [Mon Aug 29 22:39:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:39:32.880314 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55de316bb9c0 pid: 124031 (default app) Aug 29 22:40:56.574115 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:56.577784 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001671 Aug 29 22:40:56.577784 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 2/2] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:40:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:40:56.589843 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writing DB stats nova_api:SELECT=3 {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:56.591656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writing DB stats nova_cell0:SELECT=3 {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:56.593016 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writing DB stats nova_cell1:SELECT=3 {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:56.593810 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:40:57.522721 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-c52b20af-97b8-403b-8acc-675beee747f0 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:40:57.558960 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-c52b20af-97b8-403b-8acc-675beee747f0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.975550 Aug 29 22:40:57.559819 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 1/3] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Aug 29 22:40:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:00.013038 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:00.014038 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-d41eb3d9-5550-490f-ace7-ea090c7f2694 None None] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Aug 29 22:41:00.014598 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 3/4] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:00.474283 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-33126976-636b-4113-b78b-355f679b4abf admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 256, "disk": 1, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "cirros256", "vcpus": 1, "rxtx_factor": 1.0}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:00.593216 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-33126976-636b-4113-b78b-355f679b4abf admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.571976 Aug 29 22:41:00.594019 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 2/5] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:41:00.821729 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-7fee4fc4-1d46-4e83-b098-b0f9398b39d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:00.829063 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_api:SELECT=3 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:00.829941 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_cell0:SELECT=3 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:00.830888 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_cell1:SELECT=3 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:00.831636 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:00.954621 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-7fee4fc4-1d46-4e83-b098-b0f9398b39d0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.352185 Aug 29 22:41:00.955392 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 4/6] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Aug 29 22:41:00 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:03.379282 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-33126976-636b-4113-b78b-355f679b4abf admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:03.380309 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-33126976-636b-4113-b78b-355f679b4abf admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Aug 29 22:41:03.380936 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 3/7] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:04.074819 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-66ae6b00-cf00-4966-8358-514a76899d87 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "ds512M", "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "id": "d1"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:04.205474 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-66ae6b00-cf00-4966-8358-514a76899d87 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.817472 Aug 29 22:41:04.206102 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 5/8] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:04.219679 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-84537397-1b2c-4df7-86cd-fa90c1b6c40c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:04.328222 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-84537397-1b2c-4df7-86cd-fa90c1b6c40c admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.112506 Aug 29 22:41:04.329243 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 4/9] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Aug 29 22:41:04 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:06.687971 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-66ae6b00-cf00-4966-8358-514a76899d87 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:06.689049 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-66ae6b00-cf00-4966-8358-514a76899d87 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 29 22:41:06.689442 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 6/10] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:07.107411 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-3225769a-8e8f-4d7c-bf25-a449cb560511 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:07.186298 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-3225769a-8e8f-4d7c-bf25-a449cb560511 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489119 Aug 29 22:41:07.186861 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 5/11] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:07.199253 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-2fac812f-576e-4bda-b339-719ac700b6db admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:07.275023 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-2fac812f-576e-4bda-b339-719ac700b6db admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079426 Aug 29 22:41:07.275619 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 7/12] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Aug 29 22:41:07 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:09.670375 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-3225769a-8e8f-4d7c-bf25-a449cb560511 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:09.671391 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-3225769a-8e8f-4d7c-bf25-a449cb560511 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 29 22:41:09.671793 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 6/13] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:10.148900 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-fbf8576b-adf7-44c4-addd-acec89ba8174 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "id": "d3", "name": "ds2G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:10.259902 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-fbf8576b-adf7-44c4-addd-acec89ba8174 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581605 Aug 29 22:41:10.261498 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 8/14] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:10.273658 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-bf8e64d7-e491-4c06-aab2-f42ef20761dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:10.378281 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-bf8e64d7-e491-4c06-aab2-f42ef20761dd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.108389 Aug 29 22:41:10.381091 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 7/15] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Aug 29 22:41:10 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:12.793631 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-fbf8576b-adf7-44c4-addd-acec89ba8174 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:12.794562 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-fbf8576b-adf7-44c4-addd-acec89ba8174 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Aug 29 22:41:12.795213 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 9/16] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:13.245449 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-0da7ceea-9a5a-4db9-be4b-fcc82d038df6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "swap": 0}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:13.341681 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-0da7ceea-9a5a-4db9-be4b-fcc82d038df6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.540265 Aug 29 22:41:13.342526 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 8/17] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:13.355256 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-941dee89-1dbf-4c0c-8d93-3ebe7718e718 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:13.468010 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-941dee89-1dbf-4c0c-8d93-3ebe7718e718 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117033 Aug 29 22:41:13.468593 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 10/18] 10.222.0.52 () {64 vars in 1336 bytes} [Mon Aug 29 22:41:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:16.358527 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-0da7ceea-9a5a-4db9-be4b-fcc82d038df6 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:16.360046 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-0da7ceea-9a5a-4db9-be4b-fcc82d038df6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002215 Aug 29 22:41:16.360852 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 9/19] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:16 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:16.851936 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-d06885ef-f182-42dd-8836-8a30c11561da admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:16.878828 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-d06885ef-f182-42dd-8836-8a30c11561da admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.511549 Aug 29 22:41:16.879402 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 11/20] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Aug 29 22:41:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:41:19.365119 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-0da7ceea-9a5a-4db9-be4b-fcc82d038df6 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:19.366397 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-0da7ceea-9a5a-4db9-be4b-fcc82d038df6 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001835 Aug 29 22:41:19.366935 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 10/21] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:19.872481 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-fb801710-f815-4282-8767-03b474fd252d admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:19.946215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-fb801710-f815-4282-8767-03b474fd252d admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.572114 Aug 29 22:41:19.946777 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 12/22] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:19.958874 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-f4b6a053-f472-4495-917f-db8c97a4a108 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:20.065559 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-f4b6a053-f472-4495-917f-db8c97a4a108 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109877 Aug 29 22:41:20.067566 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 11/23] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Aug 29 22:41:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:22.450366 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-fb801710-f815-4282-8767-03b474fd252d admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:22.451382 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-fb801710-f815-4282-8767-03b474fd252d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 29 22:41:22.451773 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 13/24] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:22.851941 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-914d2dec-b3b0-478d-b16e-ba1e4fbe30b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 2048, "rxtx_factor": 1.0, "id": "2", "name": "m1.small"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:22.932913 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-914d2dec-b3b0-478d-b16e-ba1e4fbe30b3 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.474711 Aug 29 22:41:22.933668 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 12/25] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:22.945777 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-da34ea86-be88-450d-824d-3645cd991bff admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:23.031558 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-da34ea86-be88-450d-824d-3645cd991bff admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089445 Aug 29 22:41:23.032158 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 14/26] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Aug 29 22:41:22 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:41:25.415193 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-914d2dec-b3b0-478d-b16e-ba1e4fbe30b3 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:25.417526 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-914d2dec-b3b0-478d-b16e-ba1e4fbe30b3 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002706 Aug 29 22:41:25.418145 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 13/27] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:25 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:25.882038 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-b969f90b-910b-49bd-96ef-f48230b9685f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:25.981338 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-b969f90b-910b-49bd-96ef-f48230b9685f admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.556779 Aug 29 22:41:25.989230 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 15/28] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:25 2022] POST /compute/v2.1/flavors => generated 406 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:25.994634 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-6277f524-fb69-4088-8445-0290595d47fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:26.085154 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-6277f524-fb69-4088-8445-0290595d47fa admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094167 Aug 29 22:41:26.085758 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 14/29] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Aug 29 22:41:25 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:28.539876 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-b969f90b-910b-49bd-96ef-f48230b9685f admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:28.540924 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-b969f90b-910b-49bd-96ef-f48230b9685f admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 29 22:41:28.542329 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 16/30] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:29.042153 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-e6a33be2-0dfe-41d4-a103-970c1689a128 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:29.049039 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:29.195951 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-e6a33be2-0dfe-41d4-a103-970c1689a128 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.644980 Aug 29 22:41:29.198106 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 15/31] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:29.208764 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-f9ce145a-49a0-498f-b820-8b973d5f0ce1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:29.299539 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-f9ce145a-49a0-498f-b820-8b973d5f0ce1 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094245 Aug 29 22:41:29.300703 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 17/32] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Aug 29 22:41:29 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:31.689507 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-e6a33be2-0dfe-41d4-a103-970c1689a128 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:31.691515 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-e6a33be2-0dfe-41d4-a103-970c1689a128 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002476 Aug 29 22:41:31.692122 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 16/33] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:32.220408 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-ca529ec3-5c04-43c3-ab30-b5babd79f311 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "name": "m1.xlarge", "rxtx_factor": 1.0, "ram": 16384, "disk": 160}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:32.227162 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:33.075482 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-ca529ec3-5c04-43c3-ab30-b5babd79f311 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 1.376447 Aug 29 22:41:33.076362 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 18/34] 10.222.0.52 () {64 vars in 1283 bytes} [Mon Aug 29 22:41:31 2022] POST /compute/v2.1/flavors => generated 408 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:41:33.089774 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-de5cfa0f-4da9-4ed9-bd27-af17d296dfd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:33.213996 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-de5cfa0f-4da9-4ed9-bd27-af17d296dfd4 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.128560 Aug 29 22:41:33.218993 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 17/35] 10.222.0.52 () {64 vars in 1333 bytes} [Mon Aug 29 22:41:33 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:41:52.116671 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-ca529ec3-5c04-43c3-ab30-b5babd79f311 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:52.117639 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-ca529ec3-5c04-43c3-ab30-b5babd79f311 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 29 22:41:52.118047 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 19/36] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:41:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:52.128820 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:41:52.529245 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-a6082e22-8dc6-4352-91e9-4e495a4ba750 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:52.548780 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-a6082e22-8dc6-4352-91e9-4e495a4ba750 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.424231 Aug 29 22:41:52.549325 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 18/37] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Aug 29 22:41:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:53.619958 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-ca529ec3-5c04-43c3-ab30-b5babd79f311 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:53.620987 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-ca529ec3-5c04-43c3-ab30-b5babd79f311 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Aug 29 22:41:53.621385 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 20/38] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:54.148947 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-1f69bc8a-c00c-4039-ac8c-ef24afdbad94 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.155649 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.wsgi [None req-1f69bc8a-c00c-4039-ac8c-ef24afdbad94 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-1f69bc8a-c00c-4039-ac8c-ef24afdbad94 admin admin] Request method failure captured: Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Accept: application/json Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Accept-Encoding: gzip, deflate Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Connection: keep-alive Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Content-Length: 0 Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Host: 10.222.0.52 Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Openstack-Api-Version: compute 2.90 Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Openstack-System-Scope: None Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: User-Agent: python-novaclient Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Auth-Token: gAAAAABjDUCxwOT8pIasU-6DIgqdMU41bJyPVd7WTGeYlQPuo8szngYI-vLWHxJUCDNa06KTRWKsKF94SUKwPlQi0uxRwxpuQlH9Mlp0I_SY3cE3cwdRqvVzBGFpkUZbbKgXZOR21ReEcIRZ1VJnzfirxiKFcZJFHFLg-UyzDySY5YO9noo4Pk0 Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Domain-Id: None Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Domain-Name: None Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Identity-Status: Confirmed Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Is-Admin-Project: True Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Domain-Id: default Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Domain-Name: Default Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Name: admin Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Role: admin,member,reader Aug 29 22:41:54.158967 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Roles: admin,member,reader Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant: admin Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant-Name: admin Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User: admin Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Domain-Id: default Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Domain-Name: Default Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Id: 9cc82f35b5c947928c9caa5d0b7e11fc Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Name: admin Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: method: > Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: exception: Flavor 42 could not be found. Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: action_args: {'id': '42'} Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:41:54.160377 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:54.161269 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.162584 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-1f69bc8a-c00c-4039-ac8c-ef24afdbad94 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:41:54.163882 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-1f69bc8a-c00c-4039-ac8c-ef24afdbad94 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.402006 Aug 29 22:41:54.163882 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 19/39] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Aug 29 22:41:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:54.170422 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-9e44af02-3bc6-4cc8-bf6a-be9e566e2eab admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.192701 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-9e44af02-3bc6-4cc8-bf6a-be9e566e2eab admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025993 Aug 29 22:41:54.193275 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 21/40] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Aug 29 22:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:54.203735 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-a3d04e9e-ed9f-4e52-9afe-e755c0191c4d admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.227959 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-a3d04e9e-ed9f-4e52-9afe-e755c0191c4d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027883 Aug 29 22:41:54.228500 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 20/41] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Aug 29 22:41:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:54.238317 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-e76f21c8-6ef3-49ad-83e2-a7de3ad47291 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:54.243952 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.wsgi [None req-e76f21c8-6ef3-49ad-83e2-a7de3ad47291 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-e76f21c8-6ef3-49ad-83e2-a7de3ad47291 admin admin] Request method failure captured: Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Accept: application/json Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Accept-Encoding: gzip, deflate Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Connection: keep-alive Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Content-Length: 0 Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Host: 10.222.0.52 Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Openstack-Api-Version: compute 2.90 Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Openstack-System-Scope: None Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: User-Agent: python-novaclient Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Auth-Token: gAAAAABjDUCxwOT8pIasU-6DIgqdMU41bJyPVd7WTGeYlQPuo8szngYI-vLWHxJUCDNa06KTRWKsKF94SUKwPlQi0uxRwxpuQlH9Mlp0I_SY3cE3cwdRqvVzBGFpkUZbbKgXZOR21ReEcIRZ1VJnzfirxiKFcZJFHFLg-UyzDySY5YO9noo4Pk0 Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Domain-Id: None Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Domain-Name: None Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Identity-Status: Confirmed Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Is-Admin-Project: True Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Domain-Id: default Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Domain-Name: Default Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Name: admin Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Role: admin,member,reader Aug 29 22:41:54.248445 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Roles: admin,member,reader Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant: admin Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant-Name: admin Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User: admin Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Domain-Id: default Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Domain-Name: Default Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Id: 9cc82f35b5c947928c9caa5d0b7e11fc Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Name: admin Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: method: > Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: exception: Flavor 42 could not be found. Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: action_args: {'id': '42'} Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:41:54.262032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:54.263001 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:54.264037 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-e76f21c8-6ef3-49ad-83e2-a7de3ad47291 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=124032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:41:54.265087 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-e76f21c8-6ef3-49ad-83e2-a7de3ad47291 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015487 Aug 29 22:41:54.265087 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 22/42] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Aug 29 22:41:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:55.348429 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-a3d04e9e-ed9f-4e52-9afe-e755c0191c4d admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:55.349456 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-a3d04e9e-ed9f-4e52-9afe-e755c0191c4d admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 29 22:41:55.349853 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 21/43] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:55.889455 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-2b6ae9a0-84e9-49ff-9743-8f28cbbd0dd4 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:55.895436 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.wsgi [None req-2b6ae9a0-84e9-49ff-9743-8f28cbbd0dd4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-2b6ae9a0-84e9-49ff-9743-8f28cbbd0dd4 admin admin] Request method failure captured: Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Accept: application/json Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Accept-Encoding: gzip, deflate Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Connection: keep-alive Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Content-Length: 0 Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Host: 10.222.0.52 Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Openstack-Api-Version: compute 2.90 Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Openstack-System-Scope: None Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: User-Agent: python-novaclient Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Auth-Token: gAAAAABjDUCznqr7pCcS8-ixDFBJghMOYhWtPwZqgsqpihRkH6WOCnClwAA7raWf9HZbXzaf_4XHRez6TVdB4uPd2-dVm3uMBmBymib1Fm6PKpFfxfxKTs-_qpiTUsx17rd0cfHmxgM-6034PoW0U43CxC7Ga9ZgekA_xQJLWFAgzTDIuK1gw4g Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Domain-Id: None Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Domain-Name: None Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Identity-Status: Confirmed Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Is-Admin-Project: True Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Domain-Id: default Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Domain-Name: Default Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Name: admin Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Role: admin,member,reader Aug 29 22:41:55.896986 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Roles: admin,member,reader Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant: admin Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant-Name: admin Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User: admin Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Domain-Id: default Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Domain-Name: Default Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Id: 9cc82f35b5c947928c9caa5d0b7e11fc Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Name: admin Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: method: > Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: exception: Flavor 84 could not be found. Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: action_args: {'id': '84'} Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:41:55.898324 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:55.899186 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.900538 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-2b6ae9a0-84e9-49ff-9743-8f28cbbd0dd4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:41:55.901903 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-2b6ae9a0-84e9-49ff-9743-8f28cbbd0dd4 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.410804 Aug 29 22:41:55.901903 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Aug 29 22:41:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:55.908992 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-c836fbf4-c3cb-4c0c-8c41-5a8677781ba0 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:55.923678 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-c836fbf4-c3cb-4c0c-8c41-5a8677781ba0 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018323 Aug 29 22:41:55.924224 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 22/45] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Aug 29 22:41:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:55.934500 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-057daa74-6835-4144-9293-62c031bcd95e admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:55.950551 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-057daa74-6835-4144-9293-62c031bcd95e admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020163 Aug 29 22:41:55.951100 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Aug 29 22:41:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:55.960908 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-9f41f488-c4d9-4526-a5eb-40effb1ae92c admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:55.966615 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.wsgi [None req-9f41f488-c4d9-4526-a5eb-40effb1ae92c admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-9f41f488-c4d9-4526-a5eb-40effb1ae92c admin admin] Request method failure captured: Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Accept: application/json Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Accept-Encoding: gzip, deflate Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Connection: keep-alive Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Content-Length: 0 Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Host: 10.222.0.52 Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Openstack-Api-Version: compute 2.90 Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Openstack-System-Scope: None Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: User-Agent: python-novaclient Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Auth-Token: gAAAAABjDUCznqr7pCcS8-ixDFBJghMOYhWtPwZqgsqpihRkH6WOCnClwAA7raWf9HZbXzaf_4XHRez6TVdB4uPd2-dVm3uMBmBymib1Fm6PKpFfxfxKTs-_qpiTUsx17rd0cfHmxgM-6034PoW0U43CxC7Ga9ZgekA_xQJLWFAgzTDIuK1gw4g Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Domain-Id: None Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Domain-Name: None Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Identity-Status: Confirmed Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Is-Admin-Project: True Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Domain-Id: default Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Domain-Name: Default Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Name: admin Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Role: admin,member,reader Aug 29 22:41:55.969329 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Roles: admin,member,reader Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant: admin Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant-Name: admin Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User: admin Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Domain-Id: default Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Domain-Name: Default Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Id: 9cc82f35b5c947928c9caa5d0b7e11fc Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Name: admin Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: method: > Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: exception: Flavor 84 could not be found. Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: action_args: {'id': '84'} Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:41:55.970838 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:55.971801 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:55.973185 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-9f41f488-c4d9-4526-a5eb-40effb1ae92c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=124031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:41:55.974398 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-9f41f488-c4d9-4526-a5eb-40effb1ae92c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012349 Aug 29 22:41:55.974398 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 23/47] 10.222.0.52 () {60 vars in 1190 bytes} [Mon Aug 29 22:41:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:56.944462 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-057daa74-6835-4144-9293-62c031bcd95e admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:56.945529 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-057daa74-6835-4144-9293-62c031bcd95e admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001770 Aug 29 22:41:56.945918 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 25/48] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:57.475810 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-0c112d5f-f435-4bf6-807c-e0d8b9a2006d admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:57.481849 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.wsgi [None req-0c112d5f-f435-4bf6-807c-e0d8b9a2006d admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-0c112d5f-f435-4bf6-807c-e0d8b9a2006d admin admin] Request method failure captured: Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Accept: application/json Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Accept-Encoding: gzip, deflate Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Connection: keep-alive Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Content-Length: 0 Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Host: 10.222.0.52 Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Openstack-Api-Version: compute 2.90 Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Openstack-System-Scope: None Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: User-Agent: python-novaclient Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Auth-Token: gAAAAABjDUC0J2rC9f569EA0jdME8j9iCNNpF_X5zbPZf9gHEy4Gj6AUP_WCKim7GJGd8DGgu0L930AnHZlNavP11_YoMDLbgVCgTMLWeU7XyTLBYDPigxSRQ-451uHBKBPJbKeWi0Al9Er9NzwIOXUuhSZsB78TC2F71Pci3OD1b7aSyf95o9o Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Domain-Id: None Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Domain-Name: None Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Identity-Status: Confirmed Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Is-Admin-Project: True Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Domain-Id: default Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Domain-Name: Default Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Project-Name: admin Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Role: admin,member,reader Aug 29 22:41:57.483348 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Roles: admin,member,reader Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant: admin Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-Tenant-Name: admin Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User: admin Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Domain-Id: default Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Domain-Name: Default Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Id: 9cc82f35b5c947928c9caa5d0b7e11fc Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: X-User-Name: admin Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: method: > Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: exception: Flavor 451 could not be found. Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: action_args: {'id': '451'} Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:41:57.486656 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:57.487614 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.488974 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-0c112d5f-f435-4bf6-807c-e0d8b9a2006d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124031) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:41:57.490184 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-0c112d5f-f435-4bf6-807c-e0d8b9a2006d admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400906 Aug 29 22:41:57.490184 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 24/49] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Aug 29 22:41:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:57.496645 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-117a8c5e-d431-41dc-bd7a-78a6cdea6d38 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:57.512393 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-117a8c5e-d431-41dc-bd7a-78a6cdea6d38 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019891 Aug 29 22:41:57.513213 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 26/50] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Aug 29 22:41:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:57.524053 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:57.541484 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020646 Aug 29 22:41:57.542056 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 25/51] 10.222.0.52 () {60 vars in 1210 bytes} [Mon Aug 29 22:41:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:41:57.551649 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-ff94c701-3a74-49fc-8f26-df5bafae1135 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:57.558125 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.wsgi [None req-ff94c701-3a74-49fc-8f26-df5bafae1135 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-ff94c701-3a74-49fc-8f26-df5bafae1135 admin admin] Request method failure captured: Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Accept: application/json Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Accept-Encoding: gzip, deflate Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Connection: keep-alive Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Content-Length: 0 Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Host: 10.222.0.52 Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Openstack-Api-Version: compute 2.90 Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Openstack-System-Scope: None Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: User-Agent: python-novaclient Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Auth-Token: gAAAAABjDUC0J2rC9f569EA0jdME8j9iCNNpF_X5zbPZf9gHEy4Gj6AUP_WCKim7GJGd8DGgu0L930AnHZlNavP11_YoMDLbgVCgTMLWeU7XyTLBYDPigxSRQ-451uHBKBPJbKeWi0Al9Er9NzwIOXUuhSZsB78TC2F71Pci3OD1b7aSyf95o9o Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Domain-Id: None Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Domain-Name: None Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Identity-Status: Confirmed Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Is-Admin-Project: True Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Openstack-Nova-Api-Version: 2.90 Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Domain-Id: default Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Domain-Name: Default Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Project-Name: admin Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Role: admin,member,reader Aug 29 22:41:57.559626 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Roles: admin,member,reader Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/eb4839200e8e45dfa0acd9e9d8f433bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant: admin Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant-Id: eb4839200e8e45dfa0acd9e9d8f433bc Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-Tenant-Name: admin Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User: admin Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Domain-Id: default Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Domain-Name: Default Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Id: 9cc82f35b5c947928c9caa5d0b7e11fc Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: X-User-Name: admin Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: method: > Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: exception: Flavor 451 could not be found. Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: action_args: {'id': '451'} Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:41:57.561215 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:57.562196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: ERROR nova.api.openstack.wsgi Aug 29 22:41:57.563242 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-ff94c701-3a74-49fc-8f26-df5bafae1135 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=124032) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:41:57.564297 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-ff94c701-3a74-49fc-8f26-df5bafae1135 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013008 Aug 29 22:41:57.564297 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 27/52] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Aug 29 22:41:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 29 22:41:58.563860 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:41:58.564909 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 29 22:41:58.565309 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 26/53] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:41:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:41:59.109291 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-082c89b0-12ab-4044-9756-b172088ae5bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:41:59.186032 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-082c89b0-12ab-4044-9756-b172088ae5bd admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.474864 Aug 29 22:41:59.186583 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 28/54] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Aug 29 22:41:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:42:00.165933 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:00.166979 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 29 22:42:00.167369 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 27/55] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:00.722911 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-09e98e46-4f77-4cb7-85c9-aaafd2a081a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:00.814612 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-09e98e46-4f77-4cb7-85c9-aaafd2a081a6 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.493547 Aug 29 22:42:00.815157 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 29/56] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Aug 29 22:42:00 2022] POST /compute/v2.1/flavors => generated 405 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:42:01.793096 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:01.794068 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Aug 29 22:42:01.794465 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 28/57] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:42:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:02.321831 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-b034b3bb-86fc-47ee-8d82-17ba292eedc0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:02.501197 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-b034b3bb-86fc-47ee-8d82-17ba292eedc0 admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.569563 Aug 29 22:42:02.501751 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 30/58] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Aug 29 22:42:01 2022] POST /compute/v2.1/flavors => generated 407 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:42:03.491293 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:03.492289 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Aug 29 22:42:03.492686 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 29/59] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:04.033046 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-d803b1b4-0069-44f8-becf-78813daf667b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:42:04.111220 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-d803b1b4-0069-44f8-becf-78813daf667b admin admin] 10.222.0.52 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.464012 Aug 29 22:42:04.111742 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 31/60] 10.222.0.52 () {64 vars in 1235 bytes} [Mon Aug 29 22:42:03 2022] POST /compute/v2.1/flavors => generated 409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:42:05.091808 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:05.092832 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Aug 29 22:42:05.093233 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 30/61] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:42:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:42:05.637143 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-82cec157-46c4-4a8c-bcb9-35744502fc7b admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:42:05.658290 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-82cec157-46c4-4a8c-bcb9-35744502fc7b admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.424516 Aug 29 22:42:05.661939 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 32/62] 10.222.0.52 () {60 vars in 1202 bytes} [Mon Aug 29 22:42:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:00.575168 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:00.576441 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-b006b3e9-092c-4959-aacc-26e334c47175 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 29 22:43:00.576709 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 31/63] 10.222.0.52 () {54 vars in 931 bytes} [Mon Aug 29 22:43:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:43:00.592038 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:00.983474 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-3c47bbc2-0997-47ca-a608-613f7fd78e8f admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.004054 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-3c47bbc2-0997-47ca-a608-613f7fd78e8f admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.419028 Aug 29 22:43:01.004597 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 33/64] 10.222.0.52 () {60 vars in 1292 bytes} [Mon Aug 29 22:43:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:43:01.025901 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG dbcounter [-] [124031] Writing DB stats nova_api:SELECT=14 {{(pid=124031) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:43:01.029783 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-bd28f4f3-a513-4e6e-989d-91fd4c8b5026 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.037287 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-bd28f4f3-a513-4e6e-989d-91fd4c8b5026 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013363 Aug 29 22:43:01.040903 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 32/65] 10.222.0.52 () {60 vars in 1283 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:01.050196 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-d98ee60a-43d5-4574-a533-a138402c918c admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.058010 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-d98ee60a-43d5-4574-a533-a138402c918c admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011386 Aug 29 22:43:01.058520 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 34/66] 10.222.0.52 () {60 vars in 1286 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:01.070182 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.078109 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011892 Aug 29 22:43:01.078624 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 33/67] 10.222.0.52 () {60 vars in 1286 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:43:01.094286 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-b62c87b0-6dd3-4d96-99ad-8cf208550c23 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:43:01.098875 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-b62c87b0-6dd3-4d96-99ad-8cf208550c23 admin admin] 10.222.0.52 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012214 Aug 29 22:43:01.099384 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 35/68] 10.222.0.52 () {60 vars in 1283 bytes} [Mon Aug 29 22:43:01 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:46:12.220324 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:12.221525 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Aug 29 22:46:12.221800 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 34/69] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:46:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:12.367137 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_api:SELECT=6 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:12.527610 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:12.533056 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.533056 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.533056 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.533056 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:12.533408 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:12.533713 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:12.569426 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-3627e1bc-7924-486a-9dca-e6a4dfc4c931 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.203378 Aug 29 22:46:12.578982 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 36/70] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Aug 29 22:46:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:46:13.418020 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:13.419069 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 29 22:46:13.419463 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:46:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:13.613100 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:13.616816 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.617295 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.617726 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.618470 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:13.618916 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:13.619335 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:13.639364 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-8df674cf-636d-4942-b6c7-d773cd25584f admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078642 Aug 29 22:46:13.639856 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 37/72] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Aug 29 22:46:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:46:24.886519 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:24.887518 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Aug 29 22:46:24.887908 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 36/73] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:46:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:25.031152 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_cell0:SELECT=4 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:25.031855 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_cell1:SELECT=4 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:25.032487 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG dbcounter [-] [124032] Writing DB stats nova_api:SELECT=8 {{(pid=124032) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:46:25.081642 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:25.085579 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.086250 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.086680 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.087396 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:25.087846 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:25.088269 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:25.114606 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-32612473-5ab1-4460-8ce1-330f476a9420 admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087802 Aug 29 22:46:25.115202 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 38/74] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Aug 29 22:46:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:46:25.949145 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: DEBUG nova.api.openstack.wsgi [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] Calling method '>' {{(pid=124031) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:25.950319 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: INFO nova.api.openstack.requestlog [None req-d9807501-00e9-4470-b1ff-af6441fac520 admin admin] 10.222.0.52 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001825 Aug 29 22:46:25.950787 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: [pid: 124031|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1074 bytes} [Mon Aug 29 22:46:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:46:26.147566 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG nova.api.openstack.wsgi [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] Calling method '>' {{(pid=124032) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:46:26.151061 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.151574 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.152005 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.152745 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:46:26.153188 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:46:26.153595 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: DEBUG oslo_concurrency.lockutils [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124032) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:46:26.175183 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: INFO nova.api.openstack.requestlog [None req-7ffcacd0-8f46-44d5-a711-3389a5cf8e5f admin admin] 10.222.0.52 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.081815 Aug 29 22:46:26.175721 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: [pid: 124032|app: 0|req: 39/76] 10.222.0.52 () {60 vars in 1193 bytes} [Mon Aug 29 22:46:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:47:26.422833 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: Mon Aug 29 22:47:26 2022 - graceful shutdown triggered... Aug 29 22:47:26.422981 dv-cinder-854269-4-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 29 22:47:26.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[124031]: Gracefully killing worker 1 (pid: 124031)... Aug 29 22:47:26.424426 dv-cinder-854269-4-iscsi devstack@n-api.service[124032]: Gracefully killing worker 2 (pid: 124032)... Aug 29 22:47:27.424946 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: worker 1 buried after 1 seconds Aug 29 22:47:27.424946 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: worker 2 buried after 1 seconds Aug 29 22:47:27.424946 dv-cinder-854269-4-iscsi devstack@n-api.service[124030]: goodbye to uWSGI. Aug 29 22:47:27.426469 dv-cinder-854269-4-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 29 22:47:27.427057 dv-cinder-854269-4-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 29 22:47:27.429992 dv-cinder-854269-4-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 29 22:47:27.442726 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 29 22:47:27 2022] *** Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: nodename: dv-cinder-854269-4-iscsi Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: machine: x86_64 Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: clock source: unix Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: pcre jit disabled Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: detected number of CPU cores: 4 Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: current working directory: / Aug 29 22:47:27.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: detected binary path: /usr/bin/uwsgi-core Aug 29 22:47:27.446138 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: your processes number limit is 47680 Aug 29 22:47:27.446138 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: your memory page size is 4096 bytes Aug 29 22:47:27.446138 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: detected max file descriptor number: 2048 Aug 29 22:47:27.446138 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: lock engine: pthread robust mutexes Aug 29 22:47:27.446138 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: thunder lock: enabled Aug 29 22:47:27.446138 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 29 22:47:27.446138 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 29 22:47:27.488123 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: Python main interpreter initialized at 0x55bf465909c0 Aug 29 22:47:27.488123 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: python threads support enabled Aug 29 22:47:27.488123 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: your server socket listen backlog is limited to 100 connections Aug 29 22:47:27.488123 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: your mercy for graceful operations on workers is 90 seconds Aug 29 22:47:27.488638 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: mapped 403077 bytes (393 KB) for 2 cores Aug 29 22:47:27.488638 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: *** Operational MODE: preforking *** Aug 29 22:47:27.488858 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: *** uWSGI is running in multiple interpreter mode *** Aug 29 22:47:27.488858 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: spawned uWSGI master process (pid: 139048) Aug 29 22:47:27.489074 dv-cinder-854269-4-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 29 22:47:27.492905 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: spawned uWSGI worker 1 (pid: 139065, cores: 1) Aug 29 22:47:27.492905 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: spawned uWSGI worker 2 (pid: 139066, cores: 1) Aug 29 22:47:27.492905 dv-cinder-854269-4-iscsi devstack@n-api.service[139048]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 29 22:47:28.164286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:47:28.172373 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 29 22:47:29.322876 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:47:29.322876 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: from cryptography.utils import int_from_bytes Aug 29 22:47:29.323511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:47:29.323511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: from cryptography.utils import int_from_bytes Aug 29 22:47:29.329710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:47:29.329710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: from cryptography.utils import int_from_bytes Aug 29 22:47:29.330209 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 29 22:47:29.330209 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: from cryptography.utils import int_from_bytes Aug 29 22:47:31.760639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:47:31.761240 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:47:31.761518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:47:31.761818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:47:31.762072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:47:31.762462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.762784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.763100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.763416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.763885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.764194 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.764512 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.764856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.765792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.766060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.766371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.766777 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-4-iscsi {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.767100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.767407 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.767713 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.768031 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.768334 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.768652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.768978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.769479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.770798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.770798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.770798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.770798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.771128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.771424 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.771744 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.772041 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.772352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.772665 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.773101 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-4-iscsi {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.773403 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.773528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 29 22:47:31.773892 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 29 22:47:31.773980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.773980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.774295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 29 22:47:31.774519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.774763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 29 22:47:31.775008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.775248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 29 22:47:31.775464 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.775667 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.775885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.776134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.776354 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.776561 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.776784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.777002 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.777231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.777231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.777612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.777817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.777974 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.778173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.778343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.778503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.778652 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.778801 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.778975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.779130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.779272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.779422 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.779563 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.779720 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.779861 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-854269-4-iscsi {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.780008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.780148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.780331 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.780484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.780675 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.780871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.781060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.781356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.781554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.781709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.781879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.782039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.782194 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.782368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.782526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.782671 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.782835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.783046 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.783195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.783354 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.783507 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.783667 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.783816 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.783963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.785072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.785231 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.785383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.785383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.785660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.785800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.786023 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.786179 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.786322 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.786463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.786625 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.786768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.786918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.787076 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.787312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-854269-4-iscsi {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.787506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.787685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.787918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.788104 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.788281 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.788470 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.788657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.788881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.789072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.789256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.789441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.789618 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.789802 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.789989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.790177 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.790362 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.790541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.790718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.790903 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.791093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.791288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.791478 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.791662 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.791838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.792027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.792214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.792399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.792587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.792794 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.792981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.793144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.793295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.793448 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.793448 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.793726 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.793867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.794020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.794162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.794334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.794334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.795246 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.795403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.795564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.795718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.795860 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.796026 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.796169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.796169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.796459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.796459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.796803 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.797041 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.797339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.797576 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.797823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.798064 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.798297 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.798545 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.798785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.799054 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.799280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.799528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.799759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.800007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.800313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.800521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.800680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.800870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.801025 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.801175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.801343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.801494 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.801636 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.801783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.801924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.802066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.802220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.802220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.802496 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.802496 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.802786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.802786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.803071 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.803212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.803352 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.52 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.803507 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.803648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.52 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.803788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.803935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.804076 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.804217 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.804367 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.804509 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.805204 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.805554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.805718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.805870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.806012 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.806159 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.806302 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.806447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.806598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.806757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.806906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.807054 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.807202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.807396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.807550 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.807721 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.807875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.808016 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.808164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.808313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.808463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.809391 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.809557 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.809708 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.809851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.809991 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.810456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.810620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.810771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.810913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.811069 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.811238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.811429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.811593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.811745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.812424 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.812568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.812709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.812902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.813090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.813261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.813460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.813686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.813912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.814063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.814216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.814358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.814498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.814640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.814807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.815778 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.815961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.816113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.816255 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.816397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.816544 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.816701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.816895 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.817051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.817193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.817341 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.817540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.817704 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.817852 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.818013 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.818169 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.818319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.818469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.818618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.818767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.818909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.819136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.819289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.819438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.819580 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.819728 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.819871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.820031 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.820174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.820322 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.820502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.820647 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.820827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.820980 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.821123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.821263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.821263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.821537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.821537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.821829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.821829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.822131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.822131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.822416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.822577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.822725 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.822867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.823237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.823237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.823531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.823682 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.823824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.823977 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.824136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.824280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.824582 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.824678 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.824793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.824879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.824962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.825080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.826155 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.826290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.826423 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.826515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.826599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.826681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.826762 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.826853 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 29 22:47:31.826945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.827028 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.827117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.827117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.827275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.827372 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.827566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828367 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.828998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829266 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829703 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829884 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.829968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830049 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830405 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830671 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.830942 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831643 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.831913 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832003 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832273 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832537 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832708 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832906 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.832997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833171 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833446 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833619 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833800 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.833985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834069 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834069 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834233 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834233 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.834928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835022 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835106 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835187 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835398 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835569 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.835658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836389 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836487 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836651 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836897 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.836992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837733 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.837988 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838072 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838788 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.838960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839207 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839299 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839391 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839726 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839810 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.839979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840157 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840341 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840683 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.840963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841052 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841326 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841783 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841865 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.841946 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842197 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842373 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842542 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842713 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842803 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842892 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.842983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843154 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843244 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843687 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843805 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.843928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.844027 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.844101 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.844281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.844428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.844843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.845159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.845409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.845492 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.845734 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.845829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.846118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.846239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.846484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.846567 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.846647 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.846720 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.846927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.847236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.847236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.847394 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.847633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.847725 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.847826 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.847922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849175 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849546 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849644 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849729 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849810 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.849972 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850156 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850330 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850413 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850672 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.850970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.851147 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.851275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.851465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.851617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.851772 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.851960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.852097 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.852284 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.852400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.852607 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.852696 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.852976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.853079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.853281 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.853403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.853593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.853707 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.853902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.854012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.854270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.854369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.854582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.854681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.854903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.855002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.855216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.855315 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.855516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.855604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.855819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.855916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.856182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.856297 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.856468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.856800 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.856800 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.856959 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.863813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.863911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.863990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864082 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864173 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864271 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864271 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864528 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864610 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864874 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.864976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865060 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865569 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865653 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865734 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.865984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866173 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.866972 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867254 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867345 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867435 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867608 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867697 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867786 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867957 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.867957 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868390 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868688 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868900 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.868983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869153 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869317 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869478 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869567 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.869962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870041 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870300 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870723 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.870916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871007 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871441 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871703 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.871880 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872056 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872154 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872245 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872569 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872876 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.872986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873078 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873438 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873721 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.873824 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.874029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.874128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.874865 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.874985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.875206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.875357 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.875577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.875685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.875898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.875990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.876206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.876304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.876506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.876597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.876869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.876970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.877129 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.877221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.877470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.877560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.877773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.877863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.878109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.878207 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.878416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.878514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.878731 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.878869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.879047 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.879156 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.879347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.879445 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.879661 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.879760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.879959 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.880049 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.880259 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.880357 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.880567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.880668 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.880909 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.881052 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.881360 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.881486 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.881661 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.881825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.881969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.882144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.882275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.882466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.882566 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.882790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.882908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.883135 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.883228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.883451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.883553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.883752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.883843 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.884064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.884180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.884371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.884468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.884672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.884798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.884997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.885092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.885299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.885400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.885600 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.885697 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.885901 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.885992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.886203 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.886300 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.886498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.886585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.886803 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.886893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.887102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.887199 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.887401 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.887498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.887698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.887790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.888000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.888090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.888301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.888402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.888601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.888692 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.888940 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.889044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.889243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.889350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.889541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.889630 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.889840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.890508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.890739 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.890866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.891040 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.891138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.891343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.891433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.891649 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.891748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.891969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.892061 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.892284 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.892382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.892585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.892683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.892915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.893047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.893218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.893357 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.893526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.893665 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.893825 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.893991 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.894128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.894297 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.894426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.894604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.894726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.894910 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.895010 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.895221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.895321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.895528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.895619 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.895832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.895922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.896142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.896235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.896449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.896540 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.896777 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.896897 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.897090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.897186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.897393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.897479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.897700 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.897791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.898004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.898096 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.898319 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.898409 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.898629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.898718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.898933 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.899038 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.899238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.899337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.899545 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.899643 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.899852 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.899940 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.900150 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.900239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.900457 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.900562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.900776 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.900867 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.901086 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.901178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.901386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.901490 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.901684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.901783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.901983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.902073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.902287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.902392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.902592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.902681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.902895 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.902986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.903209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.903297 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.903516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.903604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.903816 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.903903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.904115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.904205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.904417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.904513 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.904769 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.904864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.905043 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.905135 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.905347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.905444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.905730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.905829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.906043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.906289 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.906369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.906614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.906711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.906931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.907021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.907230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.907316 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.907534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.907627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.907839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.907936 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.908139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.908235 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.908444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.908533 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.908765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.908860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.909069 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.909167 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.909373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.909463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.909672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.909763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.909977 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.910068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.910276 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.910374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.910578 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.910705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.910883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.911014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.911185 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.911321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.911527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.911625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.911831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.911921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.912187 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.912286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.912492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.912589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.912822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.912928 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.913126 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.913232 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.913438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.913527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.913748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.913845 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.914060 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.914159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.914363 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.914461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.914677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.914775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.914986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.915085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.915293 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.915382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.915592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.915681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.915896 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.915994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.916193 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.916281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.916495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.916584 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.916831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.916924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.917133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.917223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.917449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.917538 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.917769 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.917859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.918072 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.918161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.918380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.918485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.918689 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.918837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.918998 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.919145 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.919309 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.919449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.919627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.919764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.919939 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.920080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.920252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.920396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.920564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.920697 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.920902 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.921028 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.921738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.922078 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.922272 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.922354 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.922426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.922677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.922796 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.922978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.923081 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.923300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.923396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.923608 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.923710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.923915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.924006 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.924223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.924322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.924526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.924629 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.924860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.924954 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.925166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.925270 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.925577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.925666 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.925884 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.925975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.926195 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.926284 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.926499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.926599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.926809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.926899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.927113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.927211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.927421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.927519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.927723 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.927823 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.928024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.928117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.928341 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.928438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.928643 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.928778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.928978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.929071 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.929286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.929384 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.929592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.929693 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.929894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.929987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.930197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.930287 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.930515 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.930607 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.930817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.930918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.931136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.931227 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.931438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.931537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.931753 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.931842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.932055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.932146 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.932358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.932455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.932678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.932799 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.933018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.933156 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.933308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.933408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.933610 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.933800 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.933893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.934114 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.934239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.934425 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.934542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.934747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.934857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.935070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.935169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.935400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.935523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.935707 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.935822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.936020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.936127 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.936329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.936429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.936652 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.936819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.937610 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.937759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.938055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.938217 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.938310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.938394 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.938588 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.938690 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.938892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.939013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.939192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.939340 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.939565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.939698 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.939795 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.939974 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.940073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.940355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.940459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.940654 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.940776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.940979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.941080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.941333 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.941433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.941659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.941759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.941969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.942065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.942276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.942381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.942586 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.942675 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.942888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.942985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.943186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.943283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.943507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.943635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.943812 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.943905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.944125 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.944226 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.944435 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.944533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.944758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.944864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.945066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.945165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.945369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.945461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.945678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.945775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.945984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.946075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.946291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.946381 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.946601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.946713 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.946911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.947009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.947213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.947311 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.947519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.947620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.947830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.947939 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.948137 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.948225 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.948440 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.948658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.948814 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.949011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.949111 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.949321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.949414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.949629 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.949761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.949937 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.950029 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.950248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.950351 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.950811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.950903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.951117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.951208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.951424 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.951524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.951729 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.951828 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.952033 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.952134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.952361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.952495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.952882 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.953047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.953206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.953338 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.953524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.953615 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.953840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.953964 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.954149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.954238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.954458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.954575 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.954768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.954860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.955073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.955172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.955378 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.955471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.955683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.955781 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.955987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.956087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.956298 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.956387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.956602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.956691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.956934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.957038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.957241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.957341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.957543 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.957641 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.957856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.957985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.958159 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.958260 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.958461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.958551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.958769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.958870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.959079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.959179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.959396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.959486 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.959720 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.959821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.960033 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.960125 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.960342 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.960443 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.960652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.960795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.960990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.961099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.961312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.961504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.961611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.961818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.961930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.962147 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.962242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.962470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.962579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.962790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.962890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.963104 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.963206 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.963418 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.963656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.963747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.963985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.964091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.964299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.964400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.964611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.964704 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.964945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.965073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.965246 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.965367 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.965557 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.965648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.965863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.965967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.966164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.966256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.966473 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.966562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.966774 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.966871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.967102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.967373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.967471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.967721 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.967857 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.968120 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.968264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.968450 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.968598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.968762 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.968945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.969112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.969261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.969383 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.969564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.969746 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.969885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.970059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.970190 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.970363 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.970492 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.970677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.970805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.970993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.971115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.971309 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.971402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.971619 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.971724 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.971929 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.972021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.972243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.972338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.972554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.972656 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.972885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.972991 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.973186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.973288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.973498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.973597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.973800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.973889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.974102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.974194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.974410 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.974502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.974717 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.974817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.975017 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.975117 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.975318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.975417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.975618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.975717 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.975917 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.976162 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.976263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.976476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.976582 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.976915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.977122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.977224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.977430 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.977522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.977728 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.977827 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.978030 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.978140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.978379 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.978522 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.978685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.978829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.978984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.979084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.979283 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.979383 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.979588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.979678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.979892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.979982 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.980209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.980301 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.980516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.980616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.980843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.980937 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.981161 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.981259 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.981468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.981574 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.982000 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.982099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.982332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.982439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.982650 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.982752 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.982976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.983067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.983301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.983393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.983604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.984282 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.984437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.984579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.984763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.985085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.985234 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.985393 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.985493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.985699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.985798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.986004 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.986109 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.986310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.986402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.986614 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.986705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.986916 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.987022 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.987219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.987323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.987571 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.987818 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.987908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988045 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988497 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.988994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.989110 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.989297 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.989564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.989710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.989812 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.989992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.990096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.990220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.990358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.990531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.990624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.990840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.990932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.991151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.991251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.991455 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.991546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.991759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.991858 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.992062 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.992163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.992363 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.992456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.992669 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.992776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.992999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.993156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.993307 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.993398 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.993605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.993709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.993966 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.994070 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.994272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.994415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.994577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.994678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.994893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.994986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.995204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.995304 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.995519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.995609 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.995829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.995927 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.996131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.996224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.996447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.996546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.996773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.996871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.997099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.997323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.997427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.997659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.997752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.997981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.998075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.998312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.998411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.998628 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.998728 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.998928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.999020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.999230 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:31.999871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.000215 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.000497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.000594 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.000688 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.000844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.000948 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.001151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.001266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.001459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.001582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.001760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.001978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.002078 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.002387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.002496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.002608 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.002710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.002920 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.003021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.003222 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.003320 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.003522 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.003620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.003823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.003923 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.004122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.004221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.004423 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.004529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.004754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.004851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.005051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.005143 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.005356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.005467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.005658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.005757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.005957 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.006059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.006256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.006356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.006554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.006645 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.006879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.006978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.007202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.007302 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.007509 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.007609 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.007816 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.007914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.008327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.008447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.008559 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.008739 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.008832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.008935 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.009079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.009181 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.009386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.009489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.009739 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.009831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.010046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.010145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.010373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.010467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.010679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.010785 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.010986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.011085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.011291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.011389 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.011596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.011702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.011902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.011994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.012207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.012299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.012521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.012623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.012869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.012966 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.013173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.013266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.013494 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.013595 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.013805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.013905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.014120 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.014223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.014422 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.014513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.014728 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.014818 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.015178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.015279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.015381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.015468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.015665 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.015758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.015967 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.016059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.016271 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.016370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.016572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.016670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.016901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.017008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.017206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.017303 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.017511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.017602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.017821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.017925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.018129 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.018225 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.018450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.018545 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.018770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.018880 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.019074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.019166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.019375 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.019473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.019679 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.019772 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.019985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.020077 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.020301 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.020398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.020605 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.020703 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.020936 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.021039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.021239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.021331 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.021545 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.021638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.021846 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.021945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.022082 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=139065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:47:32.022179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.022500 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.022817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.023141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.023453 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.023774 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.024083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.024406 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.024741 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.025066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.025377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.025710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.026019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.026329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.026640 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.026950 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.027260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.027568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.027895 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.028220 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.028525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.028877 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.029196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.029515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.029830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.030140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.030472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.030858 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.031172 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.031479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.031790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.032099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.032415 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.032743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.033113 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.033456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.033775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.034109 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.034431 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.034742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.035067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.035392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.035741 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.036057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.036401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.036740 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.037065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.037376 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.037678 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 29 22:47:32.037969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=139066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 29 22:47:32.090281 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO dbcounter [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Registered counter for database nova_api Aug 29 22:47:32.099350 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO dbcounter [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Registered counter for database nova_api Aug 29 22:47:32.112618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_db.sqlalchemy.engines [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.119544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writer thread running {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.119907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_db.sqlalchemy.engines [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.126997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writer thread running {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.177355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.context [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37ab55e6-25c4-43ef-ae71-f79d8c00054c(cell1) {{(pid=139065) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:47:32.181440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.181923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.182291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.context [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),37ab55e6-25c4-43ef-ae71-f79d8c00054c(cell1) {{(pid=139066) load_cells /opt/stack/nova/nova/context.py:464}} Aug 29 22:47:32.183617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.184359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.184838 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.186336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.186909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.187564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.189121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.189751 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO dbcounter [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Registered counter for database nova_cell0 Aug 29 22:47:32.189866 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:47:32.190292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:47:32.192280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:47:32.193989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO dbcounter [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Registered counter for database nova_cell1 Aug 29 22:47:32.194296 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO dbcounter [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Registered counter for database nova_cell0 Aug 29 22:47:32.198289 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO dbcounter [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Registered counter for database nova_cell1 Aug 29 22:47:32.203091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_db.sqlalchemy.engines [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.203639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_db.sqlalchemy.engines [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.205959 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_db.sqlalchemy.engines [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.208364 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writer thread running {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.208765 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_db.sqlalchemy.engines [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.213043 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writer thread running {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.219146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writer thread running {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.354407 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writer thread running {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.364898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO dbcounter [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Registered counter for database nova_cell0 Aug 29 22:47:32.366332 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO dbcounter [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Registered counter for database nova_cell0 Aug 29 22:47:32.375069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_db.sqlalchemy.engines [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.376547 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_db.sqlalchemy.engines [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=139065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 29 22:47:32.379683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writer thread running {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.380999 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writer thread running {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 29 22:47:32.710593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: WARNING keystonemiddleware.auth_token [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:47:32.716182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: WARNING keystonemiddleware.auth_token [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:47:32.717989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: WARNING keystonemiddleware.auth_token [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:47:32.724736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: WARNING keystonemiddleware.auth_token [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:47:33.073140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: WARNING keystonemiddleware.auth_token [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:47:33.079687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: WARNING keystonemiddleware.auth_token [None req-64caef7f-f8bb-4343-9455-71136d8ec047 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:47:33.085165 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf465909c0 pid: 139066 (default app) Aug 29 22:47:33.094140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: WARNING keystonemiddleware.auth_token [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 29 22:47:33.100210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: WARNING keystonemiddleware.auth_token [None req-c0710faa-eda2-42e9-9392-c71e63a594f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 29 22:47:33.105610 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bf465909c0 pid: 139065 (default app) Aug 29 22:48:14.359365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:14.361104 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:14.361950 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:14.363196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:14.600181 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:14.601380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:14.602154 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:14.602933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:15.564451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6c7c5a5e-4756-40c3-9768-5f02fc3dbe11 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Action: 'create', calling method: .version_select at 0x7efc64cdee50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-240073200", "metadata": {"Type": "work"}}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:15.715672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-97aa75bb-b460-441f-bd40-98f7a2d60287 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Action: 'create', calling method: .version_select at 0x7efc64cdeee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-67706709"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:17.804152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-97aa75bb-b460-441f-bd40-98f7a2d60287 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 3.217799 Aug 29 22:48:17.805067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 1/1] 10.222.0.52 () {60 vars in 1155 bytes} [Mon Aug 29 22:48:14 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 3220 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 22:48:17.821091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7d26c16d-fb9a-48de-9bf1-fc1436831946 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64b62d30>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:17.874957 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6c7c5a5e-4756-40c3-9768-5f02fc3dbe11 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.528415 Aug 29 22:48:17.875586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 1/2] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Aug 29 22:48:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3531 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 29 22:48:17.892743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a9243f82-0912-4329-a151-126b445cf065 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Calling method '.version_select at 0x7efc64b5fca0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:18.127440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7d26c16d-fb9a-48de-9bf1-fc1436831946 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 200 len: 343 microversion: 2.1 time: 0.311419 Aug 29 22:48:18.128376 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:17 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 343 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:48:18.181997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a9243f82-0912-4329-a151-126b445cf065 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67" status: 200 len: 352 microversion: 2.1 time: 0.294662 Aug 29 22:48:18.190910 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:17 2022] GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67 => generated 352 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:19.144251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1ee7e659-d5bf-4e39-9bb9-6a0146db75e9 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64b78430>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:19.197631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4acdd5c8-1848-47b4-9ec8-be767b2957ca tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Calling method '.version_select at 0x7efc64b783a0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:19.305883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4acdd5c8-1848-47b4-9ec8-be767b2957ca tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67" status: 200 len: 353 microversion: 2.1 time: 0.112100 Aug 29 22:48:19.306619 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 3/5] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:19 2022] GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:19.321754 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-de1327af-7d61-417f-95e3-a7e6657d21cc tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Calling method '.version_select at 0x7efc64b78a60>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:19.408013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-de1327af-7d61-417f-95e3-a7e6657d21cc tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67" status: 200 len: 353 microversion: 2.1 time: 0.091384 Aug 29 22:48:19.419532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 4/6] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:19 2022] GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:19.425042 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cf1e556e-1d8b-49b0-8c85-9018b3565afe tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Calling method '.version_select at 0x7efc64b5fca0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:19.447627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1ee7e659-d5bf-4e39-9bb9-6a0146db75e9 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 200 len: 344 microversion: 2.1 time: 0.309327 Aug 29 22:48:19.448174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 3/7] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:19 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 344 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:19.464683 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e547795f-31a7-476e-89bb-c8d2e660c32a tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Action: 'create', calling method: .version_select at 0x7efc64b78a60>, body: {"snapshot": {"volume_id": "d1121724-2f08-47fc-a276-4c6b397ba428", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1252404191"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:19.767236 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cf1e556e-1d8b-49b0-8c85-9018b3565afe tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67" status: 202 len: 0 microversion: 2.1 time: 0.346068 Aug 29 22:48:19.767899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 5/8] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:48:19 2022] DELETE /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:48:19.784218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0aa8de0c-767a-4c76-be6d-492cdad81021 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Calling method '.version_select at 0x7efc64b78af0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:20.390749 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0aa8de0c-767a-4c76-be6d-492cdad81021 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67" status: 200 len: 352 microversion: 2.1 time: 0.616891 Aug 29 22:48:20.391951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 6/9] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:19 2022] GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67 => generated 352 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:20.440221 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e547795f-31a7-476e-89bb-c8d2e660c32a tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.981791 Aug 29 22:48:20.447155 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 4/10] 10.222.0.52 () {60 vars in 1162 bytes} [Mon Aug 29 22:48:19 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:20.457503 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c2196594-1cf2-418e-b109-81b56482bbef tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64b783a0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:20.749407 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c2196594-1cf2-418e-b109-81b56482bbef tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 200 len: 287 microversion: 2.1 time: 0.300738 Aug 29 22:48:20.750377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 7/11] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Aug 29 22:48:20 2022] GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 287 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:48:20.768666 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e68f72d4-21cf-47df-b27f-3ebfc339fe2a tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64b78dc0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:21.408374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-38bcff25-afb5-4a20-a773-5a76a2d75686 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Calling method '.version_select at 0x7efc64b78160>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:22.303454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-38bcff25-afb5-4a20-a773-5a76a2d75686 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] HTTP exception thrown: Volume 23abed2e-e59c-4389-95a8-7d4ff4e4de67 could not be found. Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-38bcff25-afb5-4a20-a773-5a76a2d75686 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Request method failure captured: Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67 HTTP/1.1 Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUIuAqZ1WST0HEemLzzdSOTd1Ypuce_yYb57hq2xw9zYoPmT_tWj_aqZ4I5ErMdJ_5wWtvH4ZPm3RAXF1kn-pX8MdznxPU4wCyZ2wSg2Rx_AoJ8chIRT2N8Ob_elCkdhc8_WkSnN0l9IYyKQQZcuUZBzMGCBE5wxORSpCGqI6J4Oo7Q Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 5ac28f3dbe08432e9ce0ce4e9da8b486 Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesGetTestJSON-1417036917 Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:22.311000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_5ac28f3dbe08432e9ce0ce4e9da8b486"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/5ac28f3dbe08432e9ce0ce4e9da8b486"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ac28f3dbe08432e9ce0ce4e9da8b486"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/5ac28f3dbe08432e9ce0ce4e9da8b486"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesGetTestJSON-1417036917 Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 5ac28f3dbe08432e9ce0ce4e9da8b486 Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesGetTestJSON-1417036917 Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesGetTestJSON-1417036917-project Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: d0bd8dba03a4498fa2918120389aa1cc Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesGetTestJSON-1417036917-project Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Volume 23abed2e-e59c-4389-95a8-7d4ff4e4de67 could not be found. Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '23abed2e-e59c-4389-95a8-7d4ff4e4de67'} Aug 29 22:48:22.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23abed2e-e59c-4389-95a8-7d4ff4e4de67 could not be found. (HTTP 404) (Request-ID: req-4692195d-10b0-4bc3-a11c-7260320039ed) Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:22.314838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:22.316507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23abed2e-e59c-4389-95a8-7d4ff4e4de67 could not be found. Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:48:22.317732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23abed2e-e59c-4389-95a8-7d4ff4e4de67 could not be found. Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23abed2e-e59c-4389-95a8-7d4ff4e4de67 could not be found. Aug 29 22:48:22.318994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:22.326090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-38bcff25-afb5-4a20-a773-5a76a2d75686 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] Returning 404 to user: Volume 23abed2e-e59c-4389-95a8-7d4ff4e4de67 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:22.328603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-38bcff25-afb5-4a20-a773-5a76a2d75686 tempest-VolumesGetTestJSON-1417036917 tempest-VolumesGetTestJSON-1417036917-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67" status: 404 len: 109 microversion: 2.1 time: 0.926820 Aug 29 22:48:22.333424 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 8/12] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:21 2022] GET /compute/v2.1/os-volumes/23abed2e-e59c-4389-95a8-7d4ff4e4de67 => generated 109 bytes in 932 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:48:22.396296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e68f72d4-21cf-47df-b27f-3ebfc339fe2a tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 1.638232 Aug 29 22:48:22.402976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 5/13] 10.222.0.52 () {58 vars in 1140 bytes} [Mon Aug 29 22:48:20 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:22.415331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-56fbff96-4528-439d-9c0d-5be8a307a54b tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc654e93a0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:22.546578 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-56fbff96-4528-439d-9c0d-5be8a307a54b tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 200 len: 287 microversion: 2.1 time: 0.141185 Aug 29 22:48:22.547145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 9/14] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Aug 29 22:48:22 2022] GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 287 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:23.570823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b89d6cb6-6fdf-496a-b4d4-743b450f1e3f tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64cdef70>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:23.636601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b89d6cb6-6fdf-496a-b4d4-743b450f1e3f tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 200 len: 287 microversion: 2.1 time: 0.077246 Aug 29 22:48:23.637352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 6/15] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Aug 29 22:48:23 2022] GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:24.651418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5235ac0c-e396-4ab2-b2fc-64bc8cd96255 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64acf670>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:24.742618 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5235ac0c-e396-4ab2-b2fc-64bc8cd96255 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 200 len: 287 microversion: 2.1 time: 0.096343 Aug 29 22:48:24.743436 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 10/16] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Aug 29 22:48:24 2022] GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:25.491983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-316489264", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "networks": [{"uuid": "22d29419-442a-4e58-a3c8-da734d6fd566"}]}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:25.727918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] validate_networks() for [('22d29419-442a-4e58-a3c8-da734d6fd566', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:48:25.756790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-43f5ae8d-3482-49eb-8107-de8b254236ee tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64acfca0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:25.813719 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-43f5ae8d-3482-49eb-8107-de8b254236ee tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 200 len: 288 microversion: 2.1 time: 0.061508 Aug 29 22:48:25.814729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 11/17] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Aug 29 22:48:25 2022] GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 288 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:48:25.826166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1c2ffd14-af66-4714-9abf-0d5698492a8a tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64ae63a0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:26.042860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1c2ffd14-af66-4714-9abf-0d5698492a8a tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "DELETE /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 202 len: 0 microversion: 2.1 time: 0.220176 Aug 29 22:48:26.044887 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 12/18] 10.222.0.52 () {58 vars in 1254 bytes} [Mon Aug 29 22:48:25 2022] DELETE /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:48:26.058034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2cbd5032-50be-4bc7-bde2-33821666fcdc tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64ae6a60>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:26.247870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2cbd5032-50be-4bc7-bde2-33821666fcdc tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 200 len: 287 microversion: 2.1 time: 0.197839 Aug 29 22:48:26.248601 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 13/19] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Aug 29 22:48:26 2022] GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 287 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:27.506957 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4c1264a2-4da4-467d-a8d1-9b94f869beb0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'create', calling method: .version_select at 0x7efc64acf940>, body: {"keypair": {"name": "tempest-keypair-856013112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOakLgVFrAbD3naLNrBN+Cgj0NthV5SugOntQaRLXIGxaiDB7T5c4DGtqLbrVhpW1gcFUIXmdrw8SVmpxZyhBXhfcefFNFDJtuPUGyPDHvYIxjqku12C38cGxiTJrzWeXg=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:27.610474 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-4c1264a2-4da4-467d-a8d1-9b94f869beb0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:27.623353 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-4c1264a2-4da4-467d-a8d1-9b94f869beb0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for user bcd83a222eb04368a409db06389f1b7d and project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:27.884908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4c1264a2-4da4-467d-a8d1-9b94f869beb0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.906075 Aug 29 22:48:27.895370 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 14/20] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:48:26 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:27.900449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1ec6ca74-1997-4f81-83a3-bde431ad979d tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64a48670>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:27.972681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-1ec6ca74-1997-4f81-83a3-bde431ad979d tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] HTTP exception thrown: Snapshot c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 could not be found. Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1ec6ca74-1997-4f81-83a3-bde431ad979d tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Request method failure captured: Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 HTTP/1.1 Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUIumbtWgKRGuc2YX5HXHFaS1Xqt43PtXbwGILenM-Nmu5QXAReGitu4kJfnYAKSNwL18Q2ct9hl0dEMVpguV6nQd2uNjAy738nmq-nikjEfyVs3I0i8X5dRpRvgCJ5O2Bhu84O1qp58Pk5DdhFVYATT1EwjBvanyh1tcNPaGKX252g Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:27.974981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91c111b2b38c4938ac717066e64a7262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 3a5e59d1799a4b0ba6dda59d77e91256 Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Snapshot c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 could not be found. Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31'} Aug 29 22:48:27.976299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 could not be found. (HTTP 404) (Request-ID: req-ed4b9cee-592f-4a6e-81c9-b769423c15d2) Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:27.977229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:27.978402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 could not be found. Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 29 22:48:27.979984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 could not be found. Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 could not be found. Aug 29 22:48:27.981830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:27.985549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1ec6ca74-1997-4f81-83a3-bde431ad979d tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Returning 404 to user: Snapshot c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:27.986737 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1ec6ca74-1997-4f81-83a3-bde431ad979d tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31" status: 404 len: 111 microversion: 2.1 time: 0.090266 Aug 29 22:48:27.991243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 15/21] 10.222.0.52 () {58 vars in 1251 bytes} [Mon Aug 29 22:48:27 2022] GET /compute/v2.1/os-snapshots/c0e7e0dd-e1f2-41f4-bf4f-a2af33436b31 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:28.011943 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-03689dfe-c0d9-444f-a6ea-0f324da514a4 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64a484c0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:28.328324 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-03689dfe-c0d9-444f-a6ea-0f324da514a4 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 202 len: 0 microversion: 2.1 time: 0.334050 Aug 29 22:48:28.332756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 16/22] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:48:27 2022] DELETE /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:48:28.346802 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:48:28.347924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:48:28.355023 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:48:28.355023 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:48:28.357310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:48:28.458605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.458605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.465393 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.466305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:28.466788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:28.467220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:28.582953 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Getting quotas for project cedceef6152643f7875eff039186cd55. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:28.596530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Getting quotas for user d43636bf86e441b5b72d00f85e01eac7 and project cedceef6152643f7875eff039186cd55. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:28.620585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:48:28.626961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:48:28.654163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2a13e01d-886d-42bf-a4c8-5c77348a6e07 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Action: 'create', calling method: .version_select at 0x7efc64a04280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1177137068", "metadata": {"Type": "work"}}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2a13e01d-886d-42bf-a4c8-5c77348a6e07 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Request method failure captured: Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 122 Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI7XPpj5zovI_nvaA0-borRHnIkrRyk0iHw74Tow3zO_R6AtGGC14CBN9dOOjQ63XuqfXT1bH0yI8k4Qlt9gBg_3lJAY8GmcMICdLmcAuGcJ0uxaP_gk1g8T2DMzpqRelgPKuXw73lQeM1gys-jJAZOec_yewu4q5LJE6X-WDqyvqs Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:28.665621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 57bd2ba043674ef9b23d0571e65aea4e Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1177137068", "metadata": {"Type": "work"}}} Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:28.666986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1177137068', 'metadata': {'Type': 'work'}}}} Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi '#$%' Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:28.667850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:48:28.669283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:48:28.672088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 29 22:48:28.672088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.672088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2a13e01d-886d-42bf-a4c8-5c77348a6e07 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:28.672088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2a13e01d-886d-42bf-a4c8-5c77348a6e07 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.335063 Aug 29 22:48:28.672088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 17/23] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Aug 29 22:48:28 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 338 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:48:28.685515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-00b8c10a-79b2-4de4-b6f8-e538a2208f01 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc654e9040>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:28.797913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-00b8c10a-79b2-4de4-b6f8-e538a2208f01 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 200 len: 343 microversion: 2.1 time: 0.116299 Aug 29 22:48:28.798763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 18/24] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:28 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 343 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:28.804592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b285209a-5d9d-4961-9e0a-685248fcd991 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Action: 'create', calling method: .version_select at 0x7efc64a251f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1621345112", "metadata": {"Type": "work"}}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b285209a-5d9d-4961-9e0a-685248fcd991 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Request method failure captured: Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 120 Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI7XPpj5zovI_nvaA0-borRHnIkrRyk0iHw74Tow3zO_R6AtGGC14CBN9dOOjQ63XuqfXT1bH0yI8k4Qlt9gBg_3lJAY8GmcMICdLmcAuGcJ0uxaP_gk1g8T2DMzpqRelgPKuXw73lQeM1gys-jJAZOec_yewu4q5LJE6X-WDqyvqs Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:28.809870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 57bd2ba043674ef9b23d0571e65aea4e Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1621345112", "metadata": {"Type": "work"}}} Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:28.811181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1621345112', 'metadata': {'Type': 'work'}}}} Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi '0' Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:28.813146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:48:28.814204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:48:28.815083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 29 22:48:28.815083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.815083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b285209a-5d9d-4961-9e0a-685248fcd991 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:28.816994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b285209a-5d9d-4961-9e0a-685248fcd991 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016965 Aug 29 22:48:28.823714 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 19/25] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Aug 29 22:48:28 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:48:28.837481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bebce51a-a9bf-41b4-94ad-f908cf7052d7 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Action: 'create', calling method: .version_select at 0x7efc64a488b0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-796146775", "metadata": {"Type": "work"}}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bebce51a-a9bf-41b4-94ad-f908cf7052d7 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Request method failure captured: Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 118 Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI7XPpj5zovI_nvaA0-borRHnIkrRyk0iHw74Tow3zO_R6AtGGC14CBN9dOOjQ63XuqfXT1bH0yI8k4Qlt9gBg_3lJAY8GmcMICdLmcAuGcJ0uxaP_gk1g8T2DMzpqRelgPKuXw73lQeM1gys-jJAZOec_yewu4q5LJE6X-WDqyvqs Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:28.847516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 57bd2ba043674ef9b23d0571e65aea4e Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-796146775", "metadata": {"Type": "work"}}} Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:28.848614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-796146775', 'metadata': {'Type': 'work'}}}} Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise error Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi '' Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:28.849275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 29 22:48:28.850308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 29 22:48:28.851201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 29 22:48:28.851201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.851201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bebce51a-a9bf-41b4-94ad-f908cf7052d7 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:28.851201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-bebce51a-a9bf-41b4-94ad-f908cf7052d7 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.024200 Aug 29 22:48:28.859563 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 20/26] 10.222.0.52 () {60 vars in 1156 bytes} [Mon Aug 29 22:48:28 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:48:28.872689 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cca09d59-5e34-40aa-808a-65ba0188b271 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Calling method '.version_select at 0x7efc64acfdc0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:28.898908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bd7f71fa-dafd-4286-ae8d-f2a3c49ff57f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.647910 Aug 29 22:48:28.899564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 7/27] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:48:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3650 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:48:28.917015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-02e2acf8-d424-4497-8a57-ce3aa7d549b4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:28.917654 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-02e2acf8-d424-4497-8a57-ce3aa7d549b4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-cca09d59-5e34-40aa-808a-65ba0188b271 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] HTTP exception thrown: Volume tempest-invalid-1864616416 could not be found. Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cca09d59-5e34-40aa-808a-65ba0188b271 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Request method failure captured: Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1864616416 HTTP/1.1 Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI7XPpj5zovI_nvaA0-borRHnIkrRyk0iHw74Tow3zO_R6AtGGC14CBN9dOOjQ63XuqfXT1bH0yI8k4Qlt9gBg_3lJAY8GmcMICdLmcAuGcJ0uxaP_gk1g8T2DMzpqRelgPKuXw73lQeM1gys-jJAZOec_yewu4q5LJE6X-WDqyvqs Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:28.934200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 57bd2ba043674ef9b23d0571e65aea4e Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Volume tempest-invalid-1864616416 could not be found. Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'tempest-invalid-1864616416'} Aug 29 22:48:28.935293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1864616416 could not be found. (HTTP 404) (Request-ID: req-fb222ca6-44f9-4b07-992e-a2af7d9206e6) Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.935913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:48:28.936905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1864616416 could not be found. Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:28.938085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1864616416 could not be found. Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1864616416 could not be found. Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:28.940623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cca09d59-5e34-40aa-808a-65ba0188b271 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Returning 404 to user: Volume tempest-invalid-1864616416 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:28.943251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cca09d59-5e34-40aa-808a-65ba0188b271 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1864616416" status: 404 len: 99 microversion: 2.1 time: 0.082300 Aug 29 22:48:28.948446 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 21/28] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Aug 29 22:48:28 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1864616416 => generated 99 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 29 22:48:28.957092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1c65bdcb-43d8-4691-a437-d8df07f5a38f tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007367 Aug 29 22:48:28.962840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 22/29] 10.222.0.52 () {58 vars in 1140 bytes} [Mon Aug 29 22:48:28 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 22:48:28.969990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-584e7b51-9805-4a35-8625-9886e27203f6 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005553 Aug 29 22:48:28.975516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 23/30] 10.222.0.52 () {58 vars in 1137 bytes} [Mon Aug 29 22:48:28 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 29 22:48:28.981522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-70c4142c-7874-40d2-aab0-a9a26093d891 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Calling method '.version_select at 0x7efc64a25e50>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:29.050146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-70c4142c-7874-40d2-aab0-a9a26093d891 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] HTTP exception thrown: Volume e034b17e-c776-4dbb-b157-2c006f3297c0 could not be found. Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-70c4142c-7874-40d2-aab0-a9a26093d891 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Request method failure captured: Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: DELETE /compute/v2.1/os-volumes/e034b17e-c776-4dbb-b157-2c006f3297c0 HTTP/1.1 Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI7XPpj5zovI_nvaA0-borRHnIkrRyk0iHw74Tow3zO_R6AtGGC14CBN9dOOjQ63XuqfXT1bH0yI8k4Qlt9gBg_3lJAY8GmcMICdLmcAuGcJ0uxaP_gk1g8T2DMzpqRelgPKuXw73lQeM1gys-jJAZOec_yewu4q5LJE6X-WDqyvqs Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:29.060105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 57bd2ba043674ef9b23d0571e65aea4e Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Volume e034b17e-c776-4dbb-b157-2c006f3297c0 could not be found. Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'e034b17e-c776-4dbb-b157-2c006f3297c0'} Aug 29 22:48:29.061288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e034b17e-c776-4dbb-b157-2c006f3297c0 could not be found. (HTTP 404) (Request-ID: req-5393834f-1abc-4410-8213-44ef43df31ad) Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:29.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:48:29.062993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e034b17e-c776-4dbb-b157-2c006f3297c0 could not be found. Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:48:29.063860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e034b17e-c776-4dbb-b157-2c006f3297c0 could not be found. Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e034b17e-c776-4dbb-b157-2c006f3297c0 could not be found. Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-70c4142c-7874-40d2-aab0-a9a26093d891 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Returning 404 to user: Volume e034b17e-c776-4dbb-b157-2c006f3297c0 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-70c4142c-7874-40d2-aab0-a9a26093d891 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/e034b17e-c776-4dbb-b157-2c006f3297c0" status: 404 len: 109 microversion: 2.1 time: 0.076926 Aug 29 22:48:29.067087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 24/31] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:48:28 2022] DELETE /compute/v2.1/os-volumes/e034b17e-c776-4dbb-b157-2c006f3297c0 => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:29.069836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5f732b3c-9b9a-479e-9385-0df3676adbb2 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Calling method '.version_select at 0x7efc64a48f70>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:29.145451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-5f732b3c-9b9a-479e-9385-0df3676adbb2 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] HTTP exception thrown: Volume 41ec5468-0da2-451d-8a3f-14eed044df34 could not be found. Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5f732b3c-9b9a-479e-9385-0df3676adbb2 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Request method failure captured: Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/os-volumes/41ec5468-0da2-451d-8a3f-14eed044df34 HTTP/1.1 Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI7XPpj5zovI_nvaA0-borRHnIkrRyk0iHw74Tow3zO_R6AtGGC14CBN9dOOjQ63XuqfXT1bH0yI8k4Qlt9gBg_3lJAY8GmcMICdLmcAuGcJ0uxaP_gk1g8T2DMzpqRelgPKuXw73lQeM1gys-jJAZOec_yewu4q5LJE6X-WDqyvqs Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:29.150978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/8bb243f3e77d4496bbe7858259293a44"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 8bb243f3e77d4496bbe7858259293a44 Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesNegativeTest-730167858 Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 57bd2ba043674ef9b23d0571e65aea4e Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesNegativeTest-730167858-project Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Volume 41ec5468-0da2-451d-8a3f-14eed044df34 could not be found. Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '41ec5468-0da2-451d-8a3f-14eed044df34'} Aug 29 22:48:29.152145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41ec5468-0da2-451d-8a3f-14eed044df34 could not be found. (HTTP 404) (Request-ID: req-0c557ff0-83af-4fff-8267-3a68e36067f4) Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:29.152830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:29.153735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41ec5468-0da2-451d-8a3f-14eed044df34 could not be found. Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:48:29.154681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41ec5468-0da2-451d-8a3f-14eed044df34 could not be found. Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41ec5468-0da2-451d-8a3f-14eed044df34 could not be found. Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5f732b3c-9b9a-479e-9385-0df3676adbb2 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] Returning 404 to user: Volume 41ec5468-0da2-451d-8a3f-14eed044df34 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5f732b3c-9b9a-479e-9385-0df3676adbb2 tempest-VolumesNegativeTest-730167858 tempest-VolumesNegativeTest-730167858-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/41ec5468-0da2-451d-8a3f-14eed044df34" status: 404 len: 109 microversion: 2.1 time: 0.089031 Aug 29 22:48:29.158208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 25/32] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:29 2022] GET /compute/v2.1/os-volumes/41ec5468-0da2-451d-8a3f-14eed044df34 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:48:29.294957 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-02e2acf8-d424-4497-8a57-ce3aa7d549b4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:29.334990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-02e2acf8-d424-4497-8a57-ce3aa7d549b4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1214 microversion: 2.1 time: 0.422191 Aug 29 22:48:29.356671 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 8/33] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:28 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1214 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:29.833281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8f7940eb-d67c-40c1-8746-34ba3d24e4e9 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64a250d0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:29.975894 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8f7940eb-d67c-40c1-8746-34ba3d24e4e9 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 200 len: 343 microversion: 2.1 time: 0.167043 Aug 29 22:48:29.976684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 26/34] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:29 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 343 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:30.367818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b5eb3104-8dfd-4fea-a7a8-52744d6ed11f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:30.368775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b5eb3104-8dfd-4fea-a7a8-52744d6ed11f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:30.522672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b5eb3104-8dfd-4fea-a7a8-52744d6ed11f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:30.531909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b5eb3104-8dfd-4fea-a7a8-52744d6ed11f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1214 microversion: 2.1 time: 0.172129 Aug 29 22:48:30.546745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 9/35] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:30 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:30.990336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-67f5b4bf-99a1-419b-833b-b8d5ff1a3758 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64a04e50>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:31.096541 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-67f5b4bf-99a1-419b-833b-b8d5ff1a3758 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 200 len: 343 microversion: 2.1 time: 0.110399 Aug 29 22:48:31.097339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 27/36] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:30 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 343 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:31.566852 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e9ff096d-07fc-4f94-8421-45fa00a74dc7 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:31.569044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e9ff096d-07fc-4f94-8421-45fa00a74dc7 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:31.705538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e9ff096d-07fc-4f94-8421-45fa00a74dc7 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:31.717930 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e9ff096d-07fc-4f94-8421-45fa00a74dc7 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1214 microversion: 2.1 time: 0.163386 Aug 29 22:48:31.719121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 10/37] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:31 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1214 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:32.029867 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-79049c6e-228a-4fa9-ac36-73e081c246ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'create', calling method: .version_select at 0x7efc64a04790>, body: {"keypair": {"name": "tempest-keypair-1632947759", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUKqxWLN9sAMfWT2BImaTAbFaCQkG61xI6LFob5IltBy2bla9Tv2CVECulyHWROSSVw4fZC5D2k1+oxeF7Tda4d6MJG0A+0Yj9oawAE/sZIiRhjUJ897utSEC28mFV2mg=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:32.066158 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-79049c6e-228a-4fa9-ac36-73e081c246ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:32.076146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-79049c6e-228a-4fa9-ac36-73e081c246ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for user 38a89946e1fb4b43aed992078dba0b4f and project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:32.114989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-01a7839b-254e-42e7-ac55-29a14d29626f tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc6423a670>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:32.240676 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-01a7839b-254e-42e7-ac55-29a14d29626f tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 200 len: 343 microversion: 2.1 time: 0.132186 Aug 29 22:48:32.241855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 11/38] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:32 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 343 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:32.285574 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-79049c6e-228a-4fa9-ac36-73e081c246ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.490952 Aug 29 22:48:32.293749 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 28/39] 10.222.0.52 () {62 vars in 1200 bytes} [Mon Aug 29 22:48:31 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 492 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 22:48:32.428044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-299090109", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:32.550092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] validate_networks() for [('e0df57fe-49a1-4753-930b-30f7d46d9482', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:48:32.741390 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:32.743240 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:32.787778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.788279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.788751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:32.796927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:32.797696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:32.798310 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:33.335748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:33.374290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c72527c9-38d0-4ccd-af7b-7620accabf83 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1218 microversion: 2.1 time: 0.638918 Aug 29 22:48:33.374787 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 29/40] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:32 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1218 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:33.385414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-049e587e-1d48-42d4-aa64-a0366a2ea543 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc649a4f70>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:33.469177 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-049e587e-1d48-42d4-aa64-a0366a2ea543 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] HTTP exception thrown: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-049e587e-1d48-42d4-aa64-a0366a2ea543 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Request method failure captured: Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 HTTP/1.1 Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUIumbtWgKRGuc2YX5HXHFaS1Xqt43PtXbwGILenM-Nmu5QXAReGitu4kJfnYAKSNwL18Q2ct9hl0dEMVpguV6nQd2uNjAy738nmq-nikjEfyVs3I0i8X5dRpRvgCJ5O2Bhu84O1qp58Pk5DdhFVYATT1EwjBvanyh1tcNPaGKX252g Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:33.471535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91c111b2b38c4938ac717066e64a7262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 3a5e59d1799a4b0ba6dda59d77e91256 Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'd1121724-2f08-47fc-a276-4c6b397ba428'} Aug 29 22:48:33.473058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. (HTTP 404) (Request-ID: req-d077fbf9-a176-40c3-890b-f63e694c8566) Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.473869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:33.475141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:48:33.476433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.477811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.479930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-049e587e-1d48-42d4-aa64-a0366a2ea543 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Returning 404 to user: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:33.481599 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-049e587e-1d48-42d4-aa64-a0366a2ea543 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 404 len: 109 microversion: 2.1 time: 0.099610 Aug 29 22:48:33.482329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 30/41] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:33 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 109 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:33.502276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-339e786b-8521-44c1-b900-c063127d29a6 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc64a043a0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:33.557260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-339e786b-8521-44c1-b900-c063127d29a6 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] HTTP exception thrown: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-339e786b-8521-44c1-b900-c063127d29a6 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Request method failure captured: Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: DELETE /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 HTTP/1.1 Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUIumbtWgKRGuc2YX5HXHFaS1Xqt43PtXbwGILenM-Nmu5QXAReGitu4kJfnYAKSNwL18Q2ct9hl0dEMVpguV6nQd2uNjAy738nmq-nikjEfyVs3I0i8X5dRpRvgCJ5O2Bhu84O1qp58Pk5DdhFVYATT1EwjBvanyh1tcNPaGKX252g Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:33.559477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91c111b2b38c4938ac717066e64a7262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 3a5e59d1799a4b0ba6dda59d77e91256 Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'd1121724-2f08-47fc-a276-4c6b397ba428'} Aug 29 22:48:33.560831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. (HTTP 404) (Request-ID: req-a65fbad9-4e74-4e0a-8ce2-5cf4c7aa2837) Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.567108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 29 22:48:33.568307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 29 22:48:33.569359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-339e786b-8521-44c1-b900-c063127d29a6 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Returning 404 to user: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:33.570526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-339e786b-8521-44c1-b900-c063127d29a6 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "DELETE /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 404 len: 109 microversion: 2.1 time: 0.074345 Aug 29 22:48:33.571871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 31/42] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:48:33 2022] DELETE /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:33.580452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-46c94dd2-f236-4598-936e-9172213e5f93 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Calling method '.version_select at 0x7efc649aef70>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:33.640472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-46c94dd2-f236-4598-936e-9172213e5f93 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] HTTP exception thrown: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-46c94dd2-f236-4598-936e-9172213e5f93 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Request method failure captured: Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 HTTP/1.1 Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUIumbtWgKRGuc2YX5HXHFaS1Xqt43PtXbwGILenM-Nmu5QXAReGitu4kJfnYAKSNwL18Q2ct9hl0dEMVpguV6nQd2uNjAy738nmq-nikjEfyVs3I0i8X5dRpRvgCJ5O2Bhu84O1qp58Pk5DdhFVYATT1EwjBvanyh1tcNPaGKX252g Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:48:33.643218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_91c111b2b38c4938ac717066e64a7262"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/91c111b2b38c4938ac717066e64a7262"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 91c111b2b38c4938ac717066e64a7262 Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-475805621 Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 3a5e59d1799a4b0ba6dda59d77e91256 Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesSnapshotsTestJSON-475805621-project Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'd1121724-2f08-47fc-a276-4c6b397ba428'} Aug 29 22:48:33.644334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. (HTTP 404) (Request-ID: req-44795e5b-bdde-4484-9b9f-138dd1c6a507) Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.645057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 29 22:48:33.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 29 22:48:33.647572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-46c94dd2-f236-4598-936e-9172213e5f93 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] Returning 404 to user: Volume d1121724-2f08-47fc-a276-4c6b397ba428 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-46c94dd2-f236-4598-936e-9172213e5f93 tempest-VolumesSnapshotsTestJSON-475805621 tempest-VolumesSnapshotsTestJSON-475805621-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428" status: 404 len: 109 microversion: 2.1 time: 0.071676 Aug 29 22:48:33.658025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 32/43] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:33 2022] GET /compute/v2.1/os-volumes/d1121724-2f08-47fc-a276-4c6b397ba428 => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:48:33.754210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:48:33.754793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:48:33.755265 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:48:33.755679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:48:33.756092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:48:33.776859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:33.783923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:33.786768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:33.787616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:33.788090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:33.788536 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:33.845562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:33.851388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for user 53f9f8eb7a20431ca0d679af45946bce and project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:33.879245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:48:33.883502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:48:34.111509 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2ce3efbb-bc7e-472a-b22d-8c006b123e34 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.785915 Aug 29 22:48:34.123470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 12/44] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:48:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1788 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:48:34.142332 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-22797712-5d62-4d15-aa57-3bfe3ebb58b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:34.142886 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-22797712-5d62-4d15-aa57-3bfe3ebb58b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:34.418411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:34.418411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:34.418411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:34.418411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:34.418904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:34.418904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:34.418904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:34.418904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:34.677894 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-22797712-5d62-4d15-aa57-3bfe3ebb58b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:34.728178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-22797712-5d62-4d15-aa57-3bfe3ebb58b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1221 microversion: 2.1 time: 0.597030 Aug 29 22:48:34.730636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 33/45] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:34 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1221 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:35.078952 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-316386912", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:35.288484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:35.303236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6fc45f6b-3bc3-4adb-a7d3-d71c1f41f4e1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1274 microversion: 2.1 time: 0.911454 Aug 29 22:48:35.304518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 13/46] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:34 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1274 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:35.353981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] validate_networks() for [('e0df57fe-49a1-4753-930b-30f7d46d9482', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:48:35.588939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-850930498", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cbc22b7-19e9-4863-99a1-541b71beccc1"}], "security_groups": [{"name": "tempest-securitygroup--523348861"}], "key_name": "tempest-keypair-856013112", "user_data": "}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:36.012479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] validate_networks() for [('3cbc22b7-19e9-4863-99a1-541b71beccc1', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:48:38.606279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:48:38.606279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:48:38.606279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:48:38.606279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:48:38.606279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:48:38.623376 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.625163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.630961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.630961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.630961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.630961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.665186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:48:38.666556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:48:38.667518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:48:38.668475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:48:38.669239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:48:38.690446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.693188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.693873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.695679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:38.696292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:38.698721 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:38.740592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:38.751682 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for user 53f9f8eb7a20431ca0d679af45946bce and project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:38.770898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:38.781686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for user bcd83a222eb04368a409db06389f1b7d and project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:38.784444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:48:38.800295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:48:38.838873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:48:38.853680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:48:39.045768 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-608dc34d-95c3-47b9-9b16-de59e1a8ee03 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.968183 Aug 29 22:48:39.047515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 34/47] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:48:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 3978 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:48:39.087550 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:39.089360 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:39.104347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:39.107937 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:39.112252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:39.114305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:39.116015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:39.116463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:39.179963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d4c2c213-1202-4f50-a772-792892b9a3a9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.592561 Aug 29 22:48:39.182251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 14/48] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:48:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 3598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:48:39.198296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a714deae-2e71-4cc0-b6d4-330e6e40e5da tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:39.200507 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a714deae-2e71-4cc0-b6d4-330e6e40e5da tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:39.678373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a714deae-2e71-4cc0-b6d4-330e6e40e5da tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:39.680047 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a714deae-2e71-4cc0-b6d4-330e6e40e5da tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1221 microversion: 2.1 time: 0.495295 Aug 29 22:48:39.697141 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 15/49] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:39 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1221 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:39.710450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a36a3064-5dd4-4d84-b3c4-24fc9541f57a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:39.711463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a36a3064-5dd4-4d84-b3c4-24fc9541f57a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:40.041915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a36a3064-5dd4-4d84-b3c4-24fc9541f57a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:40.051479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a36a3064-5dd4-4d84-b3c4-24fc9541f57a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1236 microversion: 2.1 time: 0.353083 Aug 29 22:48:40.052518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 16/50] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:39 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1236 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:40.077102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1053951197", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1b1aef3-5468-47e0-acb3-a09710f077e5"}], "security_groups": [{"name": "tempest-securitygroup--1514827558"}], "key_name": "tempest-keypair-1632947759", "user_data": "}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:40.709017 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:40.721504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-698e570e-e6fd-4f24-8501-f7ed7680060a tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 1.659145 Aug 29 22:48:40.722462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 35/51] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:39 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 1674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:40.737346 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-37b89829-0ab6-4273-a808-eb4d4fa77157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:40.737982 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-37b89829-0ab6-4273-a808-eb4d4fa77157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:40.755518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] validate_networks() for [('b1b1aef3-5468-47e0-acb3-a09710f077e5', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:48:40.916951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37b89829-0ab6-4273-a808-eb4d4fa77157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:40.924947 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-37b89829-0ab6-4273-a808-eb4d4fa77157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1221 microversion: 2.1 time: 0.201148 Aug 29 22:48:40.940805 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 36/52] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:40 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1221 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:41.075102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c03ee0e8-275c-495e-91bb-03b6ab1e6789 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:41.075780 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c03ee0e8-275c-495e-91bb-03b6ab1e6789 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:41.284505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c03ee0e8-275c-495e-91bb-03b6ab1e6789 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:41.313595 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c03ee0e8-275c-495e-91bb-03b6ab1e6789 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1236 microversion: 2.1 time: 0.241419 Aug 29 22:48:41.316475 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 37/53] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:41 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1236 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:41.712241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:48:41.712241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:48:41.712241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:48:41.712241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:48:41.712241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:48:41.743605 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:41.744304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:41.751647 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.758283 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.758918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.761702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.762609 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.763092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.763520 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.767276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.772511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.772511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:41.772511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:41.772511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:41.861008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:48:41.882824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for user 38a89946e1fb4b43aed992078dba0b4f and project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:48:41.923962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:48:41.926573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:48:42.120796 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-75c81c37-8e7b-4f4e-a676-14c7abb6de62 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.066549 Aug 29 22:48:42.126623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 17/54] 10.222.0.52 () {62 vars in 1188 bytes} [Mon Aug 29 22:48:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 2073 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 29 22:48:42.142280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:42.146952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:42.174063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:42.175251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:42.175905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:42.177132 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:42.178136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:42.178912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:42.668216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:42.705192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-852846bd-aa10-4122-aed3-3c9fdca0b00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1273 microversion: 2.1 time: 0.573751 Aug 29 22:48:42.709249 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 18/55] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:42 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1273 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:42.743399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5955928d-1106-48ca-8373-67da881da723 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:42.747519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5955928d-1106-48ca-8373-67da881da723 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:42.948120 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:42.960119 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e943baf4-03f7-4efa-9a92-d6733927bbb1 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 1.220345 Aug 29 22:48:42.965615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 38/56] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:41 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 1226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:42.995127 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:42.996106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:43.031014 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.032624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.033157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.038697 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.041977 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.044180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.490504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5955928d-1106-48ca-8373-67da881da723 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:43.499797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5955928d-1106-48ca-8373-67da881da723 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:43.505422 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5955928d-1106-48ca-8373-67da881da723 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:43.507385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5955928d-1106-48ca-8373-67da881da723 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1282 microversion: 2.20 time: 0.792016 Aug 29 22:48:43.510151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 19/57] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:42 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1282 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:43.681439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:43.697392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c6b60639-f966-4cd1-b688-03a7e46711e4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1288 microversion: 2.1 time: 0.724383 Aug 29 22:48:43.698389 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 39/58] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:42 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1288 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:43.753396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:43.754338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:43.779887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.780735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.781637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.782633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:43.783383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:43.784027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:43.901133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:43.915165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-936581aa-8b26-4cd8-bb3c-a730d79ef349 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1281 microversion: 2.1 time: 0.183214 Aug 29 22:48:43.939614 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 20/59] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:43 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1281 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:44.018702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:44.019325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:44.042478 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.043177 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.043684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.044430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.047860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.051634 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.533740 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-076b6d7a-d6dd-4dfc-8382-854a441790f7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:44.534384 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-076b6d7a-d6dd-4dfc-8382-854a441790f7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:44.555844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:44.831470 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:44.844355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a959b703-dec9-4a33-a17e-4e0fdcaa2fe9 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.826024 Aug 29 22:48:44.845599 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 40/60] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:44 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:44.850627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:44.856081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:44.875378 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.879652 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.880323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:44.881242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:44.881866 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:44.884941 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.125615 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-076b6d7a-d6dd-4dfc-8382-854a441790f7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:45.136476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-076b6d7a-d6dd-4dfc-8382-854a441790f7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:45.138002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-076b6d7a-d6dd-4dfc-8382-854a441790f7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:45.146374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-076b6d7a-d6dd-4dfc-8382-854a441790f7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1282 microversion: 2.20 time: 0.618483 Aug 29 22:48:45.164443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 21/61] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:44 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1282 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:45.168143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:45.178164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:45.200582 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.200582 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.206038 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.208392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.210712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.212266 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.283919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:45.290924 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7d74a369-bd7e-4bec-9948-5884b12b0a87 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1306 microversion: 2.1 time: 0.444042 Aug 29 22:48:45.297003 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 41/62] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:44 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1306 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:45.531613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e40f95a4-c304-47cd-9c5b-f0dfb7b7b913 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc64049af0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:45.548580 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:45.565552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1f652ae2-c91f-42dd-bb76-5f69e7828dfb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1279 microversion: 2.1 time: 0.401140 Aug 29 22:48:45.577969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 22/63] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:45 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1279 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:45.663309 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e40f95a4-c304-47cd-9c5b-f0dfb7b7b913 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/61ccd862-5676-4107-8f02-49f930fe4a3f" status: 200 len: 349 microversion: 2.1 time: 0.142004 Aug 29 22:48:45.664852 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 42/64] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:45 2022] GET /compute/v2.1/os-volumes/61ccd862-5676-4107-8f02-49f930fe4a3f => generated 349 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:45.914160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:45.914160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:45.914160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.914160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.914489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:45.914489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:45.914489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:45.914489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.175688 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:46.176209 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:46.199544 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.209997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.211154 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.214047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.215309 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.216477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.662662 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:46.676310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-369fa893-9000-4d2b-9c6b-e87c154d909e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.785975 Aug 29 22:48:46.705343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:46.718925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:46.719417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 23/65] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:45 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:46.739811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:46.740440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:46.740927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:46.742139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-999dbb5a-eff8-4194-ab65-d0d09562ebc3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1278 microversion: 2.20 time: 0.571702 Aug 29 22:48:46.745717 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 43/66] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:46 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1278 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:48:46.760813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:46.770892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.771880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:46.774137 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.775253 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.777639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.781129 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.795536 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.797223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.797223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.797223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:46.797480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:46.803504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:46.807935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.163198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:47.183505 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-039f9812-6a51-4f73-9c4a-0519d218432c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1294 microversion: 2.1 time: 0.460144 Aug 29 22:48:47.184440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 24/67] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:46 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1294 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:47.297416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:47.314442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2b0a0792-9f9a-46a9-8f49-b69b10d2be16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1279 microversion: 2.1 time: 0.566002 Aug 29 22:48:47.315606 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 44/68] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:46 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1279 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:47.667894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-049a50a5-4c90-4014-8b04-301616cc3d33 req-4663414f-02cb-41b2-a6a2-8df082cabcac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7176d304-92ee-4dd2-bfb1-4bc3caa06c41", "tag": "a490f9bd-78c0-4b80-8973-082090e51e7b"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:47.667894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-049a50a5-4c90-4014-8b04-301616cc3d33 req-4663414f-02cb-41b2-a6a2-8df082cabcac service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.667894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-049a50a5-4c90-4014-8b04-301616cc3d33 req-4663414f-02cb-41b2-a6a2-8df082cabcac service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.667894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-049a50a5-4c90-4014-8b04-301616cc3d33 req-4663414f-02cb-41b2-a6a2-8df082cabcac service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.692787 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-049a50a5-4c90-4014-8b04-301616cc3d33 req-4663414f-02cb-41b2-a6a2-8df082cabcac service nova] Creating event network-changed:a490f9bd-78c0-4b80-8973-082090e51e7b for instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 on hv-cinder-85426 Aug 29 22:48:47.693648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-049a50a5-4c90-4014-8b04-301616cc3d33 req-4663414f-02cb-41b2-a6a2-8df082cabcac service nova] Acquiring lock "compute-rpcapi-router" {{(pid=139065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 22:48:47.694482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-049a50a5-4c90-4014-8b04-301616cc3d33 req-4663414f-02cb-41b2-a6a2-8df082cabcac service nova] Acquired lock "compute-rpcapi-router" {{(pid=139065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 22:48:47.696244 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.700121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:47.700930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:47.706131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.707219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.709278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.709995 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.710758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.726813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.727564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.728160 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.728436 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.compute.rpcapi [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 22:48:47.730312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] Releasing lock "compute-rpcapi-router" {{(pid=139065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 22:48:47.731360 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.732011 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.732651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.764611 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0e9ad2be-5344-421b-92c4-6a3d0bd82f50 None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577760 Aug 29 22:48:47.765609 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 25/69] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:47.781893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:47.783992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:47.792487 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.793658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.794287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.796284 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:47.797039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:47.797711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:47.970374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.005069 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.009861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.012170 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b8bda5fd-9703-4952-9852-c46e7f71b5f9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1334 microversion: 2.20 time: 0.244554 Aug 29 22:48:48.027184 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 26/70] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:47 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1334 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:48.102686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b021ebff-5702-4628-8f4c-d89e93c283f5 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc641278b0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:48.199127 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b021ebff-5702-4628-8f4c-d89e93c283f5 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/d50a36cf-3037-4dbf-b1f3-d73d616dddfa" status: 200 len: 350 microversion: 2.1 time: 0.101939 Aug 29 22:48:48.200845 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 27/71] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:48 2022] GET /compute/v2.1/os-volumes/d50a36cf-3037-4dbf-b1f3-d73d616dddfa => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:48:48.214680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:48.215346 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:48.224849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.244943 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.246251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.249007 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.249940 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.250591 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.444489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.460396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-88396948-3e54-4100-aca2-e6726c166876 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1294 microversion: 2.1 time: 0.258151 Aug 29 22:48:48.461358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 28/72] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:48 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1294 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:48.474512 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:48.477197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:48.489280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.491507 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.496205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.497160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:48.497984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:48.498852 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:48.692637 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:48.939183 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:48.948106 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cdad36ab-b7d9-484c-affa-0516333a8f8c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1279 microversion: 2.1 time: 0.485542 Aug 29 22:48:48.954343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 29/73] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:48 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1279 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:49.043241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:49.044276 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:49.055562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.058948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.061776 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.066974 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.067856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.068684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.221086 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:49.231334 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:49.237327 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:49.238477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cac6cd8d-cf50-43d8-b841-3b3962696bec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1340 microversion: 2.20 time: 0.202517 Aug 29 22:48:49.244037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 30/74] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:49 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1340 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:48:49.487684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:49.488591 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:49.498556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.505991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.506698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.507444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:49.507901 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:49.508355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:49.740568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:49.880360 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-47bc7c89-1a69-4b32-a38e-c7b34066f909 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 2.055871 Aug 29 22:48:49.880360 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 45/75] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:47 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:49.882034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:49.882034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3b74c8f8-4b77-42d7-a8d5-f5ecd5732b2a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1294 microversion: 2.1 time: 0.365427 Aug 29 22:48:49.882034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 31/76] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:49 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1294 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:49.978820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:49.979481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:49.997633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.000868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.000868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.000868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.000868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.001260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.273116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:50.274633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:50.282216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.283027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.284320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.285548 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.292234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.293512 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.387928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:50.399585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:50.401585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:50.403029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d59edfaf-45b3-48f1-a415-4cb84b2484f0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1340 microversion: 2.20 time: 0.143015 Aug 29 22:48:50.404116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 32/77] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:50 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1340 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:48:50.473443 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:50.487564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-58190fd4-5d55-4b8c-b94d-70dd51dd4a47 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1279 microversion: 2.1 time: 0.515234 Aug 29 22:48:50.504453 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 46/78] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:49 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1279 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:50.895862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:50.897803 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:50.899362 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:50.910228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:50.931727 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.933777 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.941833 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.943111 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.953777 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.954045 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.955139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.956055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:50.957933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.958371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:50.960989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:50.962323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.465155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=20 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:51.643637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:51.679663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-374e7560-b5af-4f48-9d1c-aa0cf445ff16 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.792767 Aug 29 22:48:51.681589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 33/79] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:50 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:51.699552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5a5d51c5-47a8-438f-bf49-92ca6baa0221 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc64125d30>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:51.813830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5a5d51c5-47a8-438f-bf49-92ca6baa0221 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/4159a4a6-a54d-4fb9-9530-cac00b448e6d" status: 200 len: 350 microversion: 2.1 time: 0.132252 Aug 29 22:48:51.822994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 34/80] 10.222.0.52 () {58 vars in 1245 bytes} [Mon Aug 29 22:48:51 2022] GET /compute/v2.1/os-volumes/4159a4a6-a54d-4fb9-9530-cac00b448e6d => generated 350 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:51.824774 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:51.825398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:51.834646 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.835215 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.835717 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:51.836413 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:51.837019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:51.837441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.152418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.165211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-94f47e53-811a-4ead-b417-73196c67c63c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 1.274970 Aug 29 22:48:52.165797 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 47/81] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:50 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:52.179602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.190327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:52.190327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.190327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.190327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.190676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.190676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.190676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.212906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.230686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.231681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.235199 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c7425685-a639-4878-b8e8-fd92a6372350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.418643 Aug 29 22:48:52.238640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 35/82] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:51 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:52.259513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-98f14ca4-a054-4425-ada1-480f09e14c17 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc641251f0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.413701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-98f14ca4-a054-4425-ada1-480f09e14c17 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.166999 Aug 29 22:48:52.417936 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 36/83] 10.222.0.52 () {58 vars in 1134 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:52.672900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:52.689347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-32768d4d-bce3-45df-98bb-d5b81932e9b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.522480 Aug 29 22:48:52.694097 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 48/84] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:52.710899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1b91e5dc-aad7-4045-97d6-843255ad98c2 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc6403e0d0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.753167 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-69d3e441-212b-4faf-bff1-9865de3dc694 req-624a28bc-4325-4cca-bec4-c1b05268b3fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "946259ef-7337-4d98-9db7-9746c01d05c6", "tag": "d86c40c3-059f-442c-8987-09c2f2683ad5"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:52.779458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-69d3e441-212b-4faf-bff1-9865de3dc694 req-624a28bc-4325-4cca-bec4-c1b05268b3fc service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.780570 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-69d3e441-212b-4faf-bff1-9865de3dc694 req-624a28bc-4325-4cca-bec4-c1b05268b3fc service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.781025 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-69d3e441-212b-4faf-bff1-9865de3dc694 req-624a28bc-4325-4cca-bec4-c1b05268b3fc service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.798712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-69d3e441-212b-4faf-bff1-9865de3dc694 req-624a28bc-4325-4cca-bec4-c1b05268b3fc service nova] Creating event network-changed:d86c40c3-059f-442c-8987-09c2f2683ad5 for instance 946259ef-7337-4d98-9db7-9746c01d05c6 on hv-cinder-85426 Aug 29 22:48:52.805973 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-69d3e441-212b-4faf-bff1-9865de3dc694 req-624a28bc-4325-4cca-bec4-c1b05268b3fc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.386037 Aug 29 22:48:52.807716 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 37/85] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:52.809967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1b91e5dc-aad7-4045-97d6-843255ad98c2 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.114508 Aug 29 22:48:52.819555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 49/86] 10.222.0.52 () {58 vars in 1149 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:52.819555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.819555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:52.824778 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-9a3d0eef-c243-41fe-af1c-ff160ed8992b req-86b9d120-c276-496c-82d5-919fce19f05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d449df-3756-44b7-b3a5-12ff3702f6bb", "tag": "d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:52.826187 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.827987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.828149 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.829080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.829676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.830243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.838092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-9a3d0eef-c243-41fe-af1c-ff160ed8992b req-86b9d120-c276-496c-82d5-919fce19f05d service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:52.838675 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-9a3d0eef-c243-41fe-af1c-ff160ed8992b req-86b9d120-c276-496c-82d5-919fce19f05d service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:52.842415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-9a3d0eef-c243-41fe-af1c-ff160ed8992b req-86b9d120-c276-496c-82d5-919fce19f05d service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:52.843722 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:52.854085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-9a3d0eef-c243-41fe-af1c-ff160ed8992b req-86b9d120-c276-496c-82d5-919fce19f05d service nova] Creating event network-changed:d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7 for instance a1d449df-3756-44b7-b3a5-12ff3702f6bb on hv-cinder-85426 Aug 29 22:48:52.862404 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-9a3d0eef-c243-41fe-af1c-ff160ed8992b req-86b9d120-c276-496c-82d5-919fce19f05d service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052584 Aug 29 22:48:52.863343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 38/87] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:52.876619 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9a137fc6-991e-4711-899d-332c06fcd702 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc64125c10>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:52.981686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9a137fc6-991e-4711-899d-332c06fcd702 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.110557 Aug 29 22:48:52.991842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 39/88] 10.222.0.52 () {58 vars in 1134 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:52.997037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a641f09d-46ca-4132-8bfd-9055beb91cbb tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc64127160>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.129461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a641f09d-46ca-4132-8bfd-9055beb91cbb tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.136054 Aug 29 22:48:53.130632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 40/89] 10.222.0.52 () {58 vars in 1167 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:53.169427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-60e75265-23aa-4059-ba3b-ee43322cffb3 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc641605e0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.316313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-60e75265-23aa-4059-ba3b-ee43322cffb3 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.167299 Aug 29 22:48:53.318088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.318859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 41/90] 10.222.0.52 () {58 vars in 1170 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:53.335475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.336310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:53.349494 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-202762b6-ae05-41fb-a446-40605ea4d188 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.517531 Aug 29 22:48:53.350491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 50/91] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:52 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:53.351724 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.352437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.353293 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.354479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.355277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.355599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.355881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:53.356568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.373041 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.374539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.375239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.376382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.376952 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.377374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.558446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.579709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-11e4a619-4c4d-40f0-a588-cbd03d5d8a4c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.259714 Aug 29 22:48:53.580886 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 42/92] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:53.602228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1c20d64c-e081-4b26-adc7-70cf455cf139 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc64127e50>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.778983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1c20d64c-e081-4b26-adc7-70cf455cf139 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.196842 Aug 29 22:48:53.792252 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 43/93] 10.222.0.52 () {58 vars in 1155 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:53.798848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:53.799816 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:53.807579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.809305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.809961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.810893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:53.811760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:53.813121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:53.862411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.873656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.876498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:53.877680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-511f38d8-ccae-430a-aa4b-d755e988e0d4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.526542 Aug 29 22:48:53.882538 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 51/94] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:53.891886 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-31e98672-eaff-4096-a28c-dbe3eb44a3b5 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc64056d30>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.033364 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-31e98672-eaff-4096-a28c-dbe3eb44a3b5 tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.149689 Aug 29 22:48:54.033936 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 52/95] 10.222.0.52 () {58 vars in 1188 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:54.049510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d451f614-8334-47ab-8aea-db1cc62a739c tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] Calling method '.version_select at 0x7efc64049dc0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.181260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d451f614-8334-47ab-8aea-db1cc62a739c tempest-VolumesTestJSON-821791527 tempest-VolumesTestJSON-821791527-project] 10.222.0.52 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.137847 Aug 29 22:48:54.182497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 53/96] 10.222.0.52 () {58 vars in 1155 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:54.314914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:54.323052 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3e45b65e-b814-48e0-9332-1368e5a1488d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.529300 Aug 29 22:48:54.341467 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 44/97] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:53 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:54.381454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.381454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.404888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.404888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.404888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.404888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.406648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.406648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.555213 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:54.563696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-127f64a5-7ab9-4579-a9f5-a394638397d0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.189874 Aug 29 22:48:54.564200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 54/98] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:54.606071 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.606718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.613307 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.617416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.617416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.617416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.617416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.617719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.813340 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:54.826380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90821429-6373-4dcf-ac68-2af347d45eb1", "tag": "c4b5d8f5-060a-47e7-bc2d-0768effb9dcb"}, {"name": "network-changed", "server_uuid": "786e5dbf-c75c-4eda-a2f6-ecfab5041eff", "tag": "56d72164-e144-4a4d-8603-3e2ad709ea0b"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:48:54.839515 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d8da7307-9ba9-40e6-9b9c-d1d3efa53778 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.237091 Aug 29 22:48:54.875756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 45/99] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:54.875906 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=5 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:54.884429 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.885380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.886118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.900518 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=93 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:54.914578 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:54.915392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:54.918152 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Creating event network-changed:c4b5d8f5-060a-47e7-bc2d-0768effb9dcb for instance 90821429-6373-4dcf-ac68-2af347d45eb1 on hv-cinder-85426 Aug 29 22:48:54.918779 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Creating event network-changed:56d72164-e144-4a4d-8603-3e2ad709ea0b for instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff on hv-cinder-85426 Aug 29 22:48:54.919344 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Acquiring lock "compute-rpcapi-router" {{(pid=139066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 29 22:48:54.922396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1b8b21e6-9334-4f08-bd90-98f596064f4f req-4d61ad4b-aa07-4f61-b642-afd25705d9de service nova] Acquired lock "compute-rpcapi-router" {{(pid=139066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 29 22:48:54.922396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.922396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.922681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.923471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.923983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.924913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.925267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.926185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.926892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.927842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:54.928550 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:54.929189 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:54.935561 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.compute.rpcapi [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 29 22:48:54.936602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e26059d-7380-4531-b907-49df4332cfee None None] Releasing lock "compute-rpcapi-router" {{(pid=139066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 29 22:48:54.956501 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7e26059d-7380-4531-b907-49df4332cfee None None] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.133694 Aug 29 22:48:54.958112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 55/100] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:48:54 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:48:55.137857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=38 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:55.221009 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.231197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.232764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.234219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0af8ae96-7407-43f3-bb4f-6d4c2231860b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.324030 Aug 29 22:48:55.234791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 46/101] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:54 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:48:55.349617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:55.351491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:55.363407 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.364477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.365478 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.366841 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.367794 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.368863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.572174 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.585610 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:55.586209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:55.592161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.592866 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e647d76a-3d3e-40ea-ada5-104c9e659b1e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.250856 Aug 29 22:48:55.593262 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.593571 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 56/102] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:55 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:55.593838 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.594534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.594990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.595396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.736566 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:55.744133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a0df979c-a732-4a34-837e-f94afe6e233d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.162327 Aug 29 22:48:55.744690 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 47/103] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:55 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:55.871957 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:55.872670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:55.880053 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.880537 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.881004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:55.881697 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:55.882150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:55.882575 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.248221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:56.258781 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-268deb94-6b0e-40e2-a65c-a603eecb59ac tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.391059 Aug 29 22:48:56.261486 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:56.267385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:56.273568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 57/104] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:55 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:56.274504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.275195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.275841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.276475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.276976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.277616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.582639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:56.600524 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:56.603575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:56.606956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4c29c2d7-c6bf-4a16-90ed-37ac6832629c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.349462 Aug 29 22:48:56.606956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 48/105] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:56 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:48:56.613756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:56.614462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:56.621807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.625256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.625879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.629871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.629871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.632120 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.775377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:56.776261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:56.793547 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.794041 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.794474 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:56.795214 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:56.796193 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:56.797247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.001332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.007417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4120b1e1-0074-4956-be96-3ca1c4bd3aa3 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.239472 Aug 29 22:48:57.007995 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 49/106] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:56 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:57.059238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.068115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3be7330f-0340-48af-aea9-094b302aff46 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.457750 Aug 29 22:48:57.069325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 58/107] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:56 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:57.284488 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:57.285567 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:57.295963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.296492 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.297046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.297674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.298379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.300305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.616919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.623543 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fc72e2ea-896c-437d-8cd6-20f7e6d175b7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.345886 Aug 29 22:48:57.624167 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 50/108] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:57 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:57.627712 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:57.628359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:57.634660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.635377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.636174 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.636989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:57.637444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:57.637869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:57.768178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.776446 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.779485 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:57.779485 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4013dbed-0feb-4347-8062-2e8eda148ef3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.155550 Aug 29 22:48:57.779743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 59/109] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:57 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:48:58.038696 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.041114 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.045999 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=10 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:48:58.055451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.056442 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.057313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.058451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.059310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.060409 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.095431 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.096040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.105413 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.108290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.109874 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.119068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.120705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.122208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.262015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.270699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e2a7280c-60a4-4c61-98a9-9ad586a1a2ad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.244910 Aug 29 22:48:58.271505 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 51/110] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:58.421027 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.428520 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f9c96a77-d7a9-4301-b70b-d8660cf6f853 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.337553 Aug 29 22:48:58.429102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 60/111] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:48:58.644510 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.645149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.651238 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.651708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.652130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.652831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.653273 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.653685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.801564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.805780 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:58.805780 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:58.809532 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5f55a4b4-49dd-4df1-a24d-58119cf5f110 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.168729 Aug 29 22:48:58.810109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 52/112] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:58.821692 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.822259 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.822790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.823773 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:58.824293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:58.824860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:58.966164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.974401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.975834 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:58.976945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3df6964f-f591-4f37-85f6-d54e1f5c36ff tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.176336 Aug 29 22:48:58.977499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 61/113] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:58 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:48:59.291760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.292357 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.299140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.299622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.300050 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.300745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.301187 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.301601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.430345 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:59.437905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-680bdddd-f0f1-48a8-9d46-8967db0cc46d tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.150427 Aug 29 22:48:59.438465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 53/114] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:59.449566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.452136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.456456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.456998 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.457452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.458279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.458729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.459149 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.596993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:59.605338 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5f4bd443-d8ba-4b34-8abd-bcbf5aca2bf9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.159350 Aug 29 22:48:59.605901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 62/115] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:48:59.834685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:48:59.835287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:48:59.842020 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.842776 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.843039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.844554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:48:59.844944 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:48:59.845365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:48:59.980711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:48:59.988930 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b54a73bf-e927-4643-b8c7-18cbc657f693 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.160754 Aug 29 22:48:59.989486 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 54/116] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:00.000883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:00.002638 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:00.008614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.009123 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.009548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.010230 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.010668 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.011080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.140730 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.148999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.150463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.151556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f15fb4cd-0754-4a1c-9242-4a1719d613cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.155171 Aug 29 22:49:00.152095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 63/117] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:48:59 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:49:00.458887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:00.459491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:00.465487 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.465964 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.466390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.467066 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.467536 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.467950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.599152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.607126 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4a514718-4d88-412f-92c2-d006c89f8f4f tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.152081 Aug 29 22:49:00.607695 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 55/118] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:00 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:00.627101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:00.627795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:00.634455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.635442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.636299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.637139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:00.637677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:00.638170 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:00.767496 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:00.776377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-737d7239-f88f-4a71-aea2-96375198a6c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.153655 Aug 29 22:49:00.776991 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 64/119] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:00 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:01.009627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.010231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.016080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.016998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.017594 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.018289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.018740 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.019163 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.149640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:01.159546 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-40d5e7d2-6504-42a9-85cf-3384bb6ee198 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.153746 Aug 29 22:49:01.161224 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 56/120] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:01.174713 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.175330 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.181566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.182290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.182884 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.183587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.184037 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.184633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.320150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:01.328686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:01.334706 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:01.334706 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1ba95f3d-569a-430c-a7ae-8c2c084fe1d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.161063 Aug 29 22:49:01.334706 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 65/121] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:49:01.629294 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.630005 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.635917 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.636397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.636855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.637579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.638073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.638493 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.788767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:01.800218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:01.800885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:01.812628 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.814282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-335896c3-2499-4f5c-b7ee-bdad113b33b5 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.184840 Aug 29 22:49:01.814502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 57/122] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:01.815177 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.815781 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:01.816696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:01.817321 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:01.817918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.112298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.121321 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b6e01c21-a884-49e6-ba05-66320bdfc4b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.327440 Aug 29 22:49:02.121890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 66/123] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:01 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:02.183148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:02.183851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:02.193839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.201653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.201653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.201653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.201653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.202076 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.202700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-adf843a1-83ff-423e-8597-b3de248438ce req-b7ced65e-84e3-4d0c-aed7-d26b36587738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946259ef-7337-4d98-9db7-9746c01d05c6", "name": "network-vif-plugged", "status": "completed", "tag": "d86c40c3-059f-442c-8987-09c2f2683ad5"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:02.219689 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-adf843a1-83ff-423e-8597-b3de248438ce req-b7ced65e-84e3-4d0c-aed7-d26b36587738 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.221679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-adf843a1-83ff-423e-8597-b3de248438ce req-b7ced65e-84e3-4d0c-aed7-d26b36587738 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.223382 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-adf843a1-83ff-423e-8597-b3de248438ce req-b7ced65e-84e3-4d0c-aed7-d26b36587738 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.249652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-adf843a1-83ff-423e-8597-b3de248438ce req-b7ced65e-84e3-4d0c-aed7-d26b36587738 service nova] Creating event network-vif-plugged:d86c40c3-059f-442c-8987-09c2f2683ad5 for instance 946259ef-7337-4d98-9db7-9746c01d05c6 on hv-cinder-85426 Aug 29 22:49:02.256672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-adf843a1-83ff-423e-8597-b3de248438ce req-b7ced65e-84e3-4d0c-aed7-d26b36587738 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.169611 Aug 29 22:49:02.262667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 58/124] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:02.358185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:02.359134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:02.377676 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.383785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.383785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.383785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.383785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.384171 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.491025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.502181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-63a33ea5-0e88-46c5-9200-547c8dda0925 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.323897 Aug 29 22:49:02.517458 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 67/125] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:02 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:02.630222 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.640690 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.643663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:02.645083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f0782755-a751-4f8e-bc8f-0267d53c5837 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.292859 Aug 29 22:49:02.646371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 59/126] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:02 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:49:02.836101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:02.836101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:02.843766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.844248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.846662 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:02.847419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:02.847885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:02.849419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.025752 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.033901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c0d6a878-b4e8-4172-b4fd-cf2a65ecd98b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.202836 Aug 29 22:49:03.034868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 68/127] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:02 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:03.146591 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:03.147616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:03.162847 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.166896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.166896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.166896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.166896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.169766 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.196667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:03.400908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.414764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-534f4646-3da8-4cb5-9e20-fb30ee166b9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.274866 Aug 29 22:49:03.415667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 60/128] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:03 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:03.524098 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:03.525359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:03.531967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.534094 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.534929 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.535908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.536576 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.537521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.681041 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:03.681775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:03.690289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.698583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.698583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.698583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:03.698583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:03.699072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:03.779669 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.793112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1fc33efb-94f6-4d5f-9f4e-c070f168fb07 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.268476 Aug 29 22:49:03.793821 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 69/129] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:03 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:03.880559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.889406 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.890830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:03.892491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1ac0a9be-5257-4abe-ab29-a207c7261309 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.217668 Aug 29 22:49:03.893057 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 61/130] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:03 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:49:04.055309 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.055921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.061978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.062463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.062896 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.064147 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.064652 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.065171 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.197417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:04.205629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-719fc3d2-c58d-43a9-b0e1-1546ccea9581 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.155029 Aug 29 22:49:04.206185 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 70/131] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:04.288165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-19eb9421-d974-4e34-bea3-af6c31c848f4 req-0ca9c797-65a8-4d8a-a21f-b8850bfc2652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7176d304-92ee-4dd2-bfb1-4bc3caa06c41", "name": "network-vif-plugged", "status": "completed", "tag": "a490f9bd-78c0-4b80-8973-082090e51e7b"}, {"server_uuid": "a1d449df-3756-44b7-b3a5-12ff3702f6bb", "name": "network-vif-plugged", "status": "completed", "tag": "d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:04.300945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-19eb9421-d974-4e34-bea3-af6c31c848f4 req-0ca9c797-65a8-4d8a-a21f-b8850bfc2652 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.301395 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-19eb9421-d974-4e34-bea3-af6c31c848f4 req-0ca9c797-65a8-4d8a-a21f-b8850bfc2652 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.301823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-19eb9421-d974-4e34-bea3-af6c31c848f4 req-0ca9c797-65a8-4d8a-a21f-b8850bfc2652 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.315489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-19eb9421-d974-4e34-bea3-af6c31c848f4 req-0ca9c797-65a8-4d8a-a21f-b8850bfc2652 service nova] Creating event network-vif-plugged:a490f9bd-78c0-4b80-8973-082090e51e7b for instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 on hv-cinder-85426 Aug 29 22:49:04.317451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-19eb9421-d974-4e34-bea3-af6c31c848f4 req-0ca9c797-65a8-4d8a-a21f-b8850bfc2652 service nova] Creating event network-vif-plugged:d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7 for instance a1d449df-3756-44b7-b3a5-12ff3702f6bb on hv-cinder-85426 Aug 29 22:49:04.322427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-19eb9421-d974-4e34-bea3-af6c31c848f4 req-0ca9c797-65a8-4d8a-a21f-b8850bfc2652 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038531 Aug 29 22:49:04.323735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 62/132] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:04.440557 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.441206 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.447065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.447560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.447983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.448891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.449346 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.449759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.588602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:04.596940 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-967b6bc2-6bac-474c-a377-2b3bc6ce50b7 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.160745 Aug 29 22:49:04.608144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 71/133] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:04.815418 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.816235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.822663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.823142 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.823569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.824312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.824780 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.825195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.914890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:04.915706 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:04.922449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.922998 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.923495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.924251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:04.924773 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:04.925252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:04.928145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=100 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:04.941681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:04.970864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:04.977253 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4cda609e-1f29-44d5-9f5d-a312e2907763 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.166118 Aug 29 22:49:04.977963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 63/134] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:05.226254 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:05.226855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:05.233740 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.234338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.234771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.236233 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.236701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.237152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.249611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.258439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.259880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.261001 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-19b120c6-190d-43a8-bd71-ec532465d1e3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.350314 Aug 29 22:49:05.261553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 72/135] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:04 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:49:05.410516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.423361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f007a1d6-d7b3-4c16-80a6-19f89c18a46b tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.195826 Aug 29 22:49:05.423361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 64/136] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:05 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:05.618293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:05.618904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:05.624922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.625407 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.626034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.626585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:05.627039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:05.627450 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:05.763006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:05.771709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c18ad3bf-4d56-4815-8c6c-f2ac5bc6ce66 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.157285 Aug 29 22:49:05.772276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 73/137] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:05 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:05.998711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:05.999421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.005911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.006475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.007016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.007716 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.008160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.008581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.145909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.153672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a9b67608-29cf-4224-a476-7bc80664d0bb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.158908 Aug 29 22:49:06.156367 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 65/138] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:05 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:06.284613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:06.285157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.291095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.291602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.292023 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.292761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.293236 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.293650 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.439722 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:06.440325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.446662 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.446844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.447386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.447889 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.448584 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.449280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.449756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.456912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.458424 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.459531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-df467f54-d655-4463-90eb-e18e89a4c5d1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.179198 Aug 29 22:49:06.460432 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 74/139] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:06 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:49:06.638697 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.648603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7834f69c-5baf-4f1e-84a3-686af38ae9a6 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.212910 Aug 29 22:49:06.649389 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 66/140] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:06 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:06.805028 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:06.805781 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:06.812234 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.812752 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.813177 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.815157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:06.815627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:06.816058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:06.960189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:06.971104 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4c6e8a9e-f5f2-4e4e-9586-00ca15055ae5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.168311 Aug 29 22:49:06.972098 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 75/141] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:06 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:07.175635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.176240 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:07.182612 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.183265 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.183842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.192379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.192379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.192379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.340390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:07.348490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0641ae08-6c4d-424f-8b17-547a6ab0db67 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.177655 Aug 29 22:49:07.349084 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 67/142] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:07.484213 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.485037 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:07.493136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.493618 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.494051 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.494745 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.495194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.495653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.670743 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.671462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:07.679090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.679570 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.680177 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.681019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:07.681726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:07.682137 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:07.702471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:07.727665 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:07.729587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:07.731929 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c3d9c947-dfe2-4fb2-8a9e-2579dc3ab08a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.252276 Aug 29 22:49:07.732502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 76/143] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:49:07.884087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:07.894421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6a5548c9-382e-4f71-9222-58e9ef21bdd8 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.227281 Aug 29 22:49:07.895585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 68/144] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:07.995170 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:07.996249 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:08.007224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.007829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.008478 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.009432 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.009956 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.010451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.241420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.249901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8c306972-04e7-4e79-aacc-b0bc30d70ae9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.260968 Aug 29 22:49:08.250472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 77/145] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:07 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:08.369647 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:08.370172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:08.376042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.377449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.377449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.377716 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.378166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.378582 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.550917 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.558685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-38d1d52f-977e-4031-969f-9c96a2189a18 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.193076 Aug 29 22:49:08.559242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 69/146] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:08 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:08.755892 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:08.756496 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:08.762848 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.763326 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.763791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.764453 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.764937 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.765439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.923049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:08.924052 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:08.931016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.931997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.932633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.933524 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:08.935217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:08.935815 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:08.961300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.976204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.978698 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:08.980021 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-25ced1f3-b46a-4c33-b136-431b54c8575a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1408 microversion: 2.20 time: 0.228343 Aug 29 22:49:08.981227 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 78/147] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:08 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:49:09.048659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-e776746c-ca53-4379-9717-3b64dd655ccd req-1e5200da-a2bd-4a5b-83dc-ecb2608508a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90821429-6373-4dcf-ac68-2af347d45eb1", "name": "network-vif-plugged", "status": "completed", "tag": "c4b5d8f5-060a-47e7-bc2d-0768effb9dcb"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:09.074337 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e776746c-ca53-4379-9717-3b64dd655ccd req-1e5200da-a2bd-4a5b-83dc-ecb2608508a7 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.075942 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e776746c-ca53-4379-9717-3b64dd655ccd req-1e5200da-a2bd-4a5b-83dc-ecb2608508a7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.077101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e776746c-ca53-4379-9717-3b64dd655ccd req-1e5200da-a2bd-4a5b-83dc-ecb2608508a7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.106982 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-e776746c-ca53-4379-9717-3b64dd655ccd req-1e5200da-a2bd-4a5b-83dc-ecb2608508a7 service nova] Creating event network-vif-plugged:c4b5d8f5-060a-47e7-bc2d-0768effb9dcb for instance 90821429-6373-4dcf-ac68-2af347d45eb1 on hv-cinder-85426 Aug 29 22:49:09.119867 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-e776746c-ca53-4379-9717-3b64dd655ccd req-1e5200da-a2bd-4a5b-83dc-ecb2608508a7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077299 Aug 29 22:49:09.122279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 79/148] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:09.190602 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:09.199049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5b0403df-56d9-4f5e-812c-c9c89b87e209 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1314 microversion: 2.1 time: 0.281068 Aug 29 22:49:09.199621 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 70/149] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:08 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:09.271868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.275362 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.283588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.283588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.283588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.283588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.283860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.283860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.451528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:09.460192 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9550809b-efb2-41a1-a16a-a7c51c8ee48b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.192648 Aug 29 22:49:09.461782 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 80/150] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:09.588239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:09.590332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:09.603286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.604256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.605097 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:09.606250 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:09.607532 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:09.608396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.009029 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:10.010248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:10.016831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.017319 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.017753 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.018581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.019023 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.019441 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.090832 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.099775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e4179e4e-c290-4449-b7c5-7eaafb1bcd85 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.524169 Aug 29 22:49:10.103133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 71/151] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:10.174839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.182941 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.184414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.185696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-518fd9c3-53b2-444d-966d-c5b2fd225acb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1600 microversion: 2.20 time: 0.185752 Aug 29 22:49:10.186243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 81/152] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:49:09 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1600 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:49:10.210059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:10.210775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:10.225214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:10.226048 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:10.227093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.227587 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.228018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.228748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.229198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.229615 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.232684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.233566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.234147 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.235080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.235779 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.236191 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.380526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b781f36d-62b2-4403-b7e0-15624f8e6677 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.174680 Aug 29 22:49:10.381164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 72/153] 10.222.0.52 () {60 vars in 1316 bytes} [Mon Aug 29 22:49:10 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:49:10.465394 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.479445 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d0e55c68-ff3a-44bd-be69-d6697bd86f75 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1501 microversion: 2.1 time: 0.259757 Aug 29 22:49:10.483906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:10.484736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:10.497953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 82/154] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:10 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1501 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:10.507058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.507601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.508133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.508986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:10.509555 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:10.511200 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:10.804786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:10.815503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-19fd1b8e-d9ba-4777-a1a0-c2454bff3e9a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.336301 Aug 29 22:49:10.816177 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 73/155] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:10 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:11.130017 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:11.130758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:11.137732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.138231 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.138690 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.140276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.140770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.141276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.154287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-460e98af-fa4a-4824-b1e1-5a30130a6819 req-d932b117-e680-41be-81d9-7f9d850547f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786e5dbf-c75c-4eda-a2f6-ecfab5041eff", "name": "network-vif-plugged", "status": "completed", "tag": "56d72164-e144-4a4d-8603-3e2ad709ea0b"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:11.166385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-460e98af-fa4a-4824-b1e1-5a30130a6819 req-d932b117-e680-41be-81d9-7f9d850547f3 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.166947 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-460e98af-fa4a-4824-b1e1-5a30130a6819 req-d932b117-e680-41be-81d9-7f9d850547f3 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.167360 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-460e98af-fa4a-4824-b1e1-5a30130a6819 req-d932b117-e680-41be-81d9-7f9d850547f3 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.180703 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-460e98af-fa4a-4824-b1e1-5a30130a6819 req-d932b117-e680-41be-81d9-7f9d850547f3 service nova] Creating event network-vif-plugged:56d72164-e144-4a4d-8603-3e2ad709ea0b for instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff on hv-cinder-85426 Aug 29 22:49:11.187997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-460e98af-fa4a-4824-b1e1-5a30130a6819 req-d932b117-e680-41be-81d9-7f9d850547f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037306 Aug 29 22:49:11.190202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 74/156] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:11.326832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:11.337451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-eee9592a-efea-4f26-8db7-7f43f9a4081c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.213321 Aug 29 22:49:11.338033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 83/157] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:11 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:11.838254 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:11.839074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:11.846252 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.848289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.848289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:11.848289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:11.848552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:11.848839 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.047419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-b87ba73a-9f9a-4660-936d-724afaec29c4 req-1653fae4-def2-4e23-9b63-094c847e5b00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1d449df-3756-44b7-b3a5-12ff3702f6bb", "tag": "d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:12.056883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:12.064173 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-b87ba73a-9f9a-4660-936d-724afaec29c4 req-1653fae4-def2-4e23-9b63-094c847e5b00 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.064499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3f30087e-c768-43b7-a5e9-938de5149ed6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.230480 Aug 29 22:49:12.065099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 75/158] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:11 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:12.065598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-b87ba73a-9f9a-4660-936d-724afaec29c4 req-1653fae4-def2-4e23-9b63-094c847e5b00 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.066978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-b87ba73a-9f9a-4660-936d-724afaec29c4 req-1653fae4-def2-4e23-9b63-094c847e5b00 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.087930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-b87ba73a-9f9a-4660-936d-724afaec29c4 req-1653fae4-def2-4e23-9b63-094c847e5b00 service nova] Creating event network-changed:d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7 for instance a1d449df-3756-44b7-b3a5-12ff3702f6bb on hv-cinder-85426 Aug 29 22:49:12.093705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-b87ba73a-9f9a-4660-936d-724afaec29c4 req-1653fae4-def2-4e23-9b63-094c847e5b00 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050944 Aug 29 22:49:12.096879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 84/159] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:12.359863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:12.359863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:12.366633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.367317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.368006 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.368702 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:12.369569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:12.369998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:12.556253 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:12.560760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-71dda8a4-5039-463b-94b0-66f8d621969f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.206155 Aug 29 22:49:12.561405 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 76/160] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:12 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:13.088393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:13.090549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:13.099457 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.100204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.100835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.101529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.101974 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.102387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.255742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:13.263748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6e20363e-708c-4a0a-bc62-c3a8eea7f686 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.181407 Aug 29 22:49:13.264421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 85/161] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:13 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:13.594378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:13.594378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:13.594378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:13.597399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.598188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.598900 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.599992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.600747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.601532 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.610150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02e1a34b-8f7b-4c96-9691-c1c5205e2a31"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:13.617878 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:13.624636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.625293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.626587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.627717 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:13.628505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:13.629228 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:13.814730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:13.823090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9acd6392-cf61-4e28-9a9e-7c0f833819f7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.241940 Aug 29 22:49:13.823665 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 77/162] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:13 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:14.287760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:14.288584 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:14.294614 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.295090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.295522 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.296207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.296659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.297180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.316192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:14.462660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:14.471464 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-07e14e88-8e88-4a3d-984c-e04e7b1310b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.188265 Aug 29 22:49:14.472118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 78/163] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:14 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:14.847045 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:14.847568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:14.854781 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.855329 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.855879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:14.869179 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:14.869179 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:14.869179 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.012441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:15.018738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2fe02d5a-0d21-405d-b6b6-b933136c312b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1361 microversion: 2.1 time: 0.177475 Aug 29 22:49:15.019326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 79/164] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:14 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:15.494129 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:15.495132 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:15.511148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.511148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.511148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.511148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:15.511511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:15.511511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:15.766593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:15.775237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6bc5236b-3502-4766-bc12-c5646c02b534 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1321 microversion: 2.1 time: 0.284674 Aug 29 22:49:15.779230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 80/165] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:15 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1321 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:15.876333 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-aaed01ec-df33-4aa6-9dca-65ba3e4d3855 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "POST /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.272350 Aug 29 22:49:15.877689 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 86/166] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:49:13 2022] POST /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41/os-volume_attachments => generated 194 bytes in 2275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:49:16.040142 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.040756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.047755 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.054797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.055742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.055742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.056396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.056527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.271838 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:16.279932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9f0c75a1-7519-4113-9c49-a9e2cbe8174b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1547 microversion: 2.1 time: 0.243318 Aug 29 22:49:16.284804 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 81/167] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1547 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:16.305529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.306121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.312899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.313392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.315020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.315895 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.316502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.319861 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.457897 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-43676f48-17bd-4e42-a3cc-fbc1670ff0e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.157186 Aug 29 22:49:16.458487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 87/168] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-interface => generated 284 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:16.796869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:16.798029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:16.804525 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.805168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.805817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:16.806577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:16.807112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:16.808245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.185090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:17.201092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-262d1d33-1fae-48b4-9ead-bf48b279332d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1515 microversion: 2.1 time: 0.406596 Aug 29 22:49:17.208112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 82/169] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:16 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1515 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:17.230035 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:17.232256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:17.239491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.239969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.240392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.241104 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.241550 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.241953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.265080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'flavor' on Instance uuid 786e5dbf-c75c-4eda-a2f6-ecfab5041eff {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:17.314648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:17.743617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6232f4f1-1454-449f-8c11-01bbe1b5102c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff/action" status: 200 len: 32 microversion: 2.1 time: 0.509746 Aug 29 22:49:17.743617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 88/170] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:49:17 2022] POST /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:49:17.753202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:17.753902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:17.759656 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.760130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.760864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.761764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.762356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.763095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.873281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-40090220-62cc-4fdd-b992-de809d494faa req-a68aa4d9-3409-437c-9d98-ff1aa5ba7ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90821429-6373-4dcf-ac68-2af347d45eb1", "tag": "c4b5d8f5-060a-47e7-bc2d-0768effb9dcb"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:17.894835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-40090220-62cc-4fdd-b992-de809d494faa req-a68aa4d9-3409-437c-9d98-ff1aa5ba7ed7 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:17.895588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-40090220-62cc-4fdd-b992-de809d494faa req-a68aa4d9-3409-437c-9d98-ff1aa5ba7ed7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:17.896183 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-40090220-62cc-4fdd-b992-de809d494faa req-a68aa4d9-3409-437c-9d98-ff1aa5ba7ed7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:17.920399 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-40090220-62cc-4fdd-b992-de809d494faa req-a68aa4d9-3409-437c-9d98-ff1aa5ba7ed7 service nova] Creating event network-changed:c4b5d8f5-060a-47e7-bc2d-0768effb9dcb for instance 90821429-6373-4dcf-ac68-2af347d45eb1 on hv-cinder-85426 Aug 29 22:49:17.929062 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-40090220-62cc-4fdd-b992-de809d494faa req-a68aa4d9-3409-437c-9d98-ff1aa5ba7ed7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059986 Aug 29 22:49:17.930295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 89/171] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:17.965736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:17.974873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d1cf09b9-22ea-45b5-84de-6a879a53741b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.226617 Aug 29 22:49:17.975597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 83/172] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:17 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:18.998142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:18.999719 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:19.008678 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.009292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.009786 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.010571 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:19.011114 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:19.011626 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:19.162785 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:19.169369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-16d3f161-47ef-4809-872e-c115513e33b2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.176410 Aug 29 22:49:19.170041 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 90/173] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:18 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:20.192245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:20.193002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:20.199469 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.200055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.200583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.201522 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:20.202067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:20.202575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:20.346930 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:20.354902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-564ebcd5-9b3a-490c-913e-7ad2f7070d1f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.166639 Aug 29 22:49:20.355589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 84/174] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:20 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:21.375691 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:21.376235 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:21.383683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.387893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.387893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.387893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:21.387893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:21.388246 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:21.598215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:21.606472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-74d3facc-8636-4955-bdcb-45cffd52a46f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.234996 Aug 29 22:49:21.607247 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 91/175] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:21 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:22.629587 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:22.630189 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:22.636199 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.636669 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.637130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.637798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:22.638237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:22.638646 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:22.766053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:22.774384 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-406981ef-5578-4441-ae79-2592cee20d43 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.149257 Aug 29 22:49:22.774946 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 85/176] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:22 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:23.795337 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:23.795934 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:23.802903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.803419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.803881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.804580 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:23.805069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:23.805497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:23.956297 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:23.964106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-eb426e7a-7168-4306-99d8-c6e29b88b347 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.172578 Aug 29 22:49:23.964684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 92/177] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:23 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:24.985782 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:24.986788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:24.992948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.993425 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.993852 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:24.994538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:24.994987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:24.995453 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:25.131290 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:25.138913 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2bf27810-692c-408f-a849-22598adfc690 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.156958 Aug 29 22:49:25.139481 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 86/178] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:24 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:26.159594 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:26.160217 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:26.166847 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.167333 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.167770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.168466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:26.168952 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:26.169373 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:26.507387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:26.515091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-faf5c181-4d72-4b66-a8f8-568fff418573 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.359672 Aug 29 22:49:26.515648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 93/179] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:26 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:27.535785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:27.536402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:27.542804 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.543288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.543719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.544466 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:27.544954 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:27.545378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:27.679709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:27.687351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b839c8d1-bc3f-4481-9ede-acf91e4e6a10 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.155815 Aug 29 22:49:27.687906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 87/180] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:27 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:28.709469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:28.710106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:28.712512 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=78 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:28.717234 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.717712 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.718141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.718827 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:28.719270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:28.719687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:28.849997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:28.857485 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8ebc397b-ad21-430b-8f4d-50b7117a4b96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.152464 Aug 29 22:49:28.858043 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 94/181] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:28 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:29.879597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:29.880135 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:29.886349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.887083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.887709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:29.888644 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:29.889120 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:29.889535 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:30.036757 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:30.044531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-ddc52443-2e7e-4ad3-930c-4b0914666157 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.169102 Aug 29 22:49:30.045207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 88/182] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:29 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:31.065446 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:31.066135 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:31.072428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.072934 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.073362 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.074039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:31.074487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:31.074899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:31.210141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:31.217922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e84b895a-7f55-4ff8-b15e-110d660b0256 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.156351 Aug 29 22:49:31.218480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 95/183] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:31 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:32.239738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:32.240298 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:32.246627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.247166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.247591 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.248280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:32.248945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:32.249151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:32.385350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:32.394172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c951fa90-593d-485a-8696-beb8115fb5f9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.158342 Aug 29 22:49:32.394746 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 89/184] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:32 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:33.415533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:33.416132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:33.422545 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.423023 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.423448 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.424832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:33.425283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:33.425705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:33.555285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:33.562956 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-917eda87-c3e0-4f50-a2ed-c58e15c1639d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.151224 Aug 29 22:49:33.563529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 96/185] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:33 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:34.583618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:34.584194 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:34.590189 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.590688 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.591113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.591780 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:34.592217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:34.592624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:34.739204 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:34.753075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1bb93213-36c2-4749-aa89-735ef45cd69c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.168349 Aug 29 22:49:34.753075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 90/186] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:34 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:35.768866 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:35.769627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:35.776051 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.776547 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.777085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.777825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:35.778282 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:35.778708 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:35.913128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:35.920786 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4c7bb996-ff97-46d2-badd-d3c1fba774b6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.155735 Aug 29 22:49:35.928222 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 97/187] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:35 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:36.943622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.944256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.951887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.952375 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.952833 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.958736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:36.966157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:36.966337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.966337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.966337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.966683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.967178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.967614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.969897 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:36.969897 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:36.969897 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:36.998411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:49:37.116501 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:37.126114 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a90630a5-ee12-4bc3-9bd4-b0e54d66ce33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.187162 Aug 29 22:49:37.126981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 91/188] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:36 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:37.394471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-131906af-e1a8-489c-897c-9d9a3a53d518 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 204 len: 0 microversion: 2.1 time: 0.437665 Aug 29 22:49:37.395513 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 98/189] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:49:36 2022] DELETE /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:49:37.404862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:37.412260 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:37.412260 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.412741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.413180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.413893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:37.414434 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:37.414859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:37.556809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:37.565749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f1b1dbc9-ab51-4ddd-8881-a16b25302bad tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1553 microversion: 2.1 time: 0.164866 Aug 29 22:49:37.566324 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 92/190] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:37 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1553 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:38.147929 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.148634 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.157150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.157645 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.158086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.158787 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.160136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.160595 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.300903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:38.308757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-26e35c78-cf1b-46f3-891e-a62cfb830b62 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.165600 Aug 29 22:49:38.309324 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 99/191] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:38.589377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:38.589976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:38.596173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.597051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.598631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.599383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:38.599899 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:38.600321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:38.760522 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:38.769477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-35408449-d0b0-4f42-b218-6b339756fb5e tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1553 microversion: 2.1 time: 0.183760 Aug 29 22:49:38.770778 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 93/192] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:38 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:39.341057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.341057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.341651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.341651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.342070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.342758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.343206 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.343624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.478189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:39.501586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-20096045-ca24-4815-94ae-5c8a9d0e817b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.174769 Aug 29 22:49:39.507039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 100/193] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:39.799625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:39.800392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:39.806447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.806929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.807490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.808104 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:39.808547 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:39.808985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:39.957268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:39.965558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9b3429f6-d611-44f7-b924-c4a4a08389f0 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1553 microversion: 2.1 time: 0.171694 Aug 29 22:49:39.966132 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 94/194] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:39 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1553 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:40.544615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.547490 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:40.555080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.555804 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.556466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.557273 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.557724 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.558142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.761169 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:40.770028 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-97aaa0c6-a026-4876-a977-49c201e24c3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.229206 Aug 29 22:49:40.770606 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 101/195] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:40.938494 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-cb5c1590-8c0f-4e25-b157-e1682c6c6840 req-4e58f74f-456d-47aa-94d5-1abd14e50702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7176d304-92ee-4dd2-bfb1-4bc3caa06c41", "name": "network-vif-deleted", "tag": "a490f9bd-78c0-4b80-8973-082090e51e7b"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:49:40.952749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-cb5c1590-8c0f-4e25-b157-e1682c6c6840 req-4e58f74f-456d-47aa-94d5-1abd14e50702 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:40.953839 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-cb5c1590-8c0f-4e25-b157-e1682c6c6840 req-4e58f74f-456d-47aa-94d5-1abd14e50702 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:40.954883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-cb5c1590-8c0f-4e25-b157-e1682c6c6840 req-4e58f74f-456d-47aa-94d5-1abd14e50702 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:40.961537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:40.972237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-cb5c1590-8c0f-4e25-b157-e1682c6c6840 req-4e58f74f-456d-47aa-94d5-1abd14e50702 service nova] Creating event network-vif-deleted:a490f9bd-78c0-4b80-8973-082090e51e7b for instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 on hv-cinder-85426 Aug 29 22:49:40.978638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-cb5c1590-8c0f-4e25-b157-e1682c6c6840 req-4e58f74f-456d-47aa-94d5-1abd14e50702 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044824 Aug 29 22:49:40.981493 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 95/196] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:49:40.994875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:40.995879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.004442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.005498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.005847 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.006579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.007034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.007447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.115107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:41.117515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:41.125241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f048857a-3b2f-4879-ac2c-82da601f23f4 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1511 microversion: 2.1 time: 0.141845 Aug 29 22:49:41.125820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 102/197] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:40 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1511 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:41.791918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:41.792597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:41.799044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.799563 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.800003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.801788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:41.801788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:41.801788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:41.935605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:41.944223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b0571eb1-a033-4546-a31c-fff3bebb075f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.156946 Aug 29 22:49:41.944842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 96/198] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:41 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:42.147531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.148704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.156408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.156942 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.157428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.158169 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.158626 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.159552 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.191825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.192307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.192766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.193212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lazy-loading 'fault' on Instance uuid 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:42.236370 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:42.245480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ca1f6fcc-038f-410e-ad71-61f628870129 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1350 microversion: 2.1 time: 0.102753 Aug 29 22:49:42.246047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 103/199] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:42.966242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:42.966758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:42.974015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.974490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.974919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:42.975596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:42.976042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:42.976456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.112597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:43.120990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8b9a3db7-d099-4bd3-83ac-91d738794fec tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.158402 Aug 29 22:49:43.121594 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 97/200] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:42 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:43.267065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:43.267731 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:43.275166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.275649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.276083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.276816 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.277277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.277701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.309022 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:43.309530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:43.309967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:43.310407 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lazy-loading 'fault' on Instance uuid 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:43.352330 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:43.361793 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a08337d6-efbd-4390-843c-5aca0dc5e835 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1350 microversion: 2.1 time: 0.098530 Aug 29 22:49:43.362401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 104/201] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:43 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1350 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:44.145738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.146364 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.148362 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=41 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:44.153444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.153926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.154355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.155049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.155498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.156024 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.340214 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:44.340214 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0ab9487d-f9bb-4880-a220-7afac207936d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.180166 Aug 29 22:49:44.340214 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 98/202] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:44.383653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:44.384255 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:44.390615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.396105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.396105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.396105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.396105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.396741 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.424046 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:44.424562 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:44.425025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:44.426609 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lazy-loading 'fault' on Instance uuid 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:49:44.466166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd43636bf86e441b5b72d00f85e01eac7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cedceef6152643f7875eff039186cd55', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:44.474669 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9c5408b3-6f0a-45cd-88a3-1004681fa386 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 200 len: 1350 microversion: 2.1 time: 0.094844 Aug 29 22:49:44.475235 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 105/203] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:44 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 1350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:45.349006 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.349735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.355712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.356265 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.356808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.357561 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.358077 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.358559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.494547 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:45.494950 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.495704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.502141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.502328 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6836121c-20ba-4fc3-b562-cfba7c4b8763 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.158684 Aug 29 22:49:45.502927 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 99/204] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:45.503177 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.503629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.504411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.504975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.505404 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.529817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] HTTP exception thrown: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Request method failure captured: Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 HTTP/1.1 Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI48XARkqPy1Bp8DsFJYYIrmnb8UqZq5Fj5lzR4FpJTOMPGCiIp21Xf2zp2AjPqFBtte-B3ElFPebm-NIasKMroqgLWdSavdBk_6o-jJaONDCHuBxBLoU01vLfsZ4PVcUXL7ySjjFcIdM_iyD3HMt5YQHyDwBtJehYbZqCxPl6Bwi0 Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:49:45.539139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cedceef6152643f7875eff039186cd55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cedceef6152643f7875eff039186cd55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: d43636bf86e441b5b72d00f85e01eac7 Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.540510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '7176d304-92ee-4dd2-bfb1-4bc3caa06c41'} Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:45.541369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.542567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.543751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Returning 404 to user: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:45.543751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-fdb68891-a94e-427d-a2b5-6ae27614a382 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 404 len: 111 microversion: 2.1 time: 0.046908 Aug 29 22:49:45.543751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 106/205] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:49:45.693486 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:45.695576 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:45.701501 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.701973 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.702395 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.703072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:45.703513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:45.703924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:45.718180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] HTTP exception thrown: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Request method failure captured: Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41/os-volume_attachments HTTP/1.1 Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI48XARkqPy1Bp8DsFJYYIrmnb8UqZq5Fj5lzR4FpJTOMPGCiIp21Xf2zp2AjPqFBtte-B3ElFPebm-NIasKMroqgLWdSavdBk_6o-jJaONDCHuBxBLoU01vLfsZ4PVcUXL7ySjjFcIdM_iyD3HMt5YQHyDwBtJehYbZqCxPl6Bwi0 Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:49:45.726185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cedceef6152643f7875eff039186cd55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cedceef6152643f7875eff039186cd55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: d43636bf86e441b5b72d00f85e01eac7 Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.727597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'server_id': '7176d304-92ee-4dd2-bfb1-4bc3caa06c41'} Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:45.728365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:45.729715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:45.730934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Returning 404 to user: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:45.730934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bc67a265-8f3b-4acf-8315-81a3fb248449 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035801 Aug 29 22:49:45.730934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 100/206] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:49:45 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41/os-volume_attachments => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:49:46.526349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:46.527827 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:46.535565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.536067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.536802 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.537527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:46.537988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:46.538412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:46.696985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:46.710443 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a0d4b6ee-6069-4f1e-845d-fa04c1151545 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.187808 Aug 29 22:49:46.712415 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 107/207] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:46 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:47.284843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.284843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.290481 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.290996 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.291388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.292107 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.292561 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.293004 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.308427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] HTTP exception thrown: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Request method failure captured: Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 HTTP/1.1 Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI48XARkqPy1Bp8DsFJYYIrmnb8UqZq5Fj5lzR4FpJTOMPGCiIp21Xf2zp2AjPqFBtte-B3ElFPebm-NIasKMroqgLWdSavdBk_6o-jJaONDCHuBxBLoU01vLfsZ4PVcUXL7ySjjFcIdM_iyD3HMt5YQHyDwBtJehYbZqCxPl6Bwi0 Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:49:47.311282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cedceef6152643f7875eff039186cd55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cedceef6152643f7875eff039186cd55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: d43636bf86e441b5b72d00f85e01eac7 Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.317247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '7176d304-92ee-4dd2-bfb1-4bc3caa06c41'} Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:47.318285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.319564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.320709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Returning 404 to user: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:47.320709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-eb7d7cde-710c-4e9d-b4c1-7edc0f9f6823 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "DELETE /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 404 len: 111 microversion: 2.1 time: 0.032688 Aug 29 22:49:47.320709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 101/208] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:49:47 2022] DELETE /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:49:47.324178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.324823 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] [instance: 7176d304-92ee-4dd2-bfb1-4bc3caa06c41] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.331690 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.336075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.336075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.336075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.336075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.337043 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.348215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] HTTP exception thrown: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Request method failure captured: Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 HTTP/1.1 Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI48XARkqPy1Bp8DsFJYYIrmnb8UqZq5Fj5lzR4FpJTOMPGCiIp21Xf2zp2AjPqFBtte-B3ElFPebm-NIasKMroqgLWdSavdBk_6o-jJaONDCHuBxBLoU01vLfsZ4PVcUXL7ySjjFcIdM_iyD3HMt5YQHyDwBtJehYbZqCxPl6Bwi0 Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:49:47.349784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_cedceef6152643f7875eff039186cd55"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/cedceef6152643f7875eff039186cd55"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/cedceef6152643f7875eff039186cd55"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: cedceef6152643f7875eff039186cd55 Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-DeleteServersTestJSON-571271208 Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: d43636bf86e441b5b72d00f85e01eac7 Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-DeleteServersTestJSON-571271208-project Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.351012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '7176d304-92ee-4dd2-bfb1-4bc3caa06c41'} Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:49:47.351992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. Aug 29 22:49:47.353138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:49:47.354380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] Returning 404 to user: Instance 7176d304-92ee-4dd2-bfb1-4bc3caa06c41 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:49:47.354380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2bb65689-5673-4c7d-9312-3260d0d5d913 tempest-DeleteServersTestJSON-571271208 tempest-DeleteServersTestJSON-571271208-project] 10.222.0.52 "GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41" status: 404 len: 111 microversion: 2.1 time: 0.031705 Aug 29 22:49:47.355313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 108/209] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/7176d304-92ee-4dd2-bfb1-4bc3caa06c41 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:49:47.736526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:47.737864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:47.743877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.744359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.744816 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.745614 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:47.746105 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:47.746529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:47.881524 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:47.889211 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d684b02b-5e2d-4d21-bcdb-95f6ae5a3b8a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.156575 Aug 29 22:49:47.889775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 102/210] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:47 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:48.913913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:48.914883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:48.931462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.932460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.932936 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:48.934548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:48.935964 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:48.936587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:49.174715 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:49.182426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d49d415e-59e3-4c09-b49e-b425ec0b2f9e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.274786 Aug 29 22:49:49.182984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 109/211] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:48 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:50.203459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:50.204114 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:50.214678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.215494 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.216258 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.223270 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:50.223758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:50.224196 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:50.452859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:50.461679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e0a1aaea-10c0-4436-ae0e-ad8c84562e9d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.262064 Aug 29 22:49:50.462253 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 103/212] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:50 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:51.486754 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:51.493302 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:51.498845 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.500097 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.500766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.502062 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:51.502756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:51.503382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:51.695222 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:51.706981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-68fff558-02b3-4f1f-99ca-9deb9ec518fc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.225058 Aug 29 22:49:51.708540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 110/213] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:51 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:52.728506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:52.729131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:52.735475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.735955 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.736398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.737562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:52.738109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:52.738523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:52.912445 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:52.921578 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-34dd2754-29f9-4dc6-adf4-3d4fc48853bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.196748 Aug 29 22:49:52.923476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 104/214] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:52 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:53.952037 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:53.952684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:53.960373 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.960914 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.961477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:53.962047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:53.962501 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:53.962931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:54.150860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:54.161477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-36a2b19f-387a-44af-9779-3e5f129321c3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.213524 Aug 29 22:49:54.162408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 111/215] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:53 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:55.183093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:55.183693 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:55.189436 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.189914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.190601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.191386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:55.191834 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:55.192250 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:55.387745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:55.392829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-965c8d52-8f24-4726-b35a-21f129ec474e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.213459 Aug 29 22:49:55.394174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 105/216] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:55 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:56.419389 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:56.420014 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:56.426682 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.427355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.427792 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.428496 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:56.428974 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:56.429403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:56.574687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:56.586876 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a4a727a2-4273-4090-ab12-2ea1ce28e9bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.175162 Aug 29 22:49:56.589603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 112/217] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:56 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:49:57.617377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:57.618015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:57.624128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.624607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.625067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.625751 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:57.626198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:57.626612 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:57.770825 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:57.778511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d91bfdcb-3b81-463c-a617-8b43fafff416 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.165272 Aug 29 22:49:57.779090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 106/218] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:57 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:49:58.800180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:49:58.801598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:49:58.805252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:49:58.809025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.809510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.809940 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.810641 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:49:58.811096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:49:58.811511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:49:58.998122 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:49:59.006892 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2e88ddc1-573c-45af-93c8-87d3edf5801a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1521 microversion: 2.1 time: 0.211095 Aug 29 22:49:59.008614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 113/219] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:49:58 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:00.027759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:00.028351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:00.034573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.035065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.035748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.036239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.036699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.037145 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.206292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:00.214354 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a87c61ad-70f5-4b7c-92e8-75f40b6930a8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1501 microversion: 2.1 time: 0.190925 Aug 29 22:50:00.215292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 107/220] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:00 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1501 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:00.235723 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:00.237432 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:00.244550 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.245073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.245509 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.246205 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:00.246656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:00.247096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:00.384210 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:00.391900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-56c168fb-9afc-49c3-ba71-1455835e4b7c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1516 microversion: 2.1 time: 0.160052 Aug 29 22:50:00.392468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 114/221] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:00 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:07.183930 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:07.187009 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:07.194406 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.195149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.195586 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.196286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.196781 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.197185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.226691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'flavor' on Instance uuid 946259ef-7337-4d98-9db7-9746c01d05c6 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:50:07.625523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e9f1f97c-e98d-49e2-ac26-c9107a1179ad tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6/action" status: 200 len: 32 microversion: 2.1 time: 0.441148 Aug 29 22:50:07.625523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 108/222] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:50:07 2022] POST /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:50:07.634225 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:07.634837 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:07.653139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.653139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.653139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.653139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:07.653662 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:07.653662 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:07.807924 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:07.815677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4f97ea86-3dd1-4106-a37b-67dce6e34979 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.185862 Aug 29 22:50:07.817229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 115/223] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:07 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:08.838436 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:08.839203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:08.847031 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.848018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.848606 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.849562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:08.850153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:08.850883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:08.996856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:09.005593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0e0b6049-1f63-4b97-984c-b020a3dae248 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.171345 Aug 29 22:50:09.006168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 109/224] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:08 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:10.026240 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:10.026843 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:10.033497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.033978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.034427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.035089 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.035546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.036009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.196046 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:10.204777 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-84d297d0-024c-46fd-8b9e-106025b962d0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.182272 Aug 29 22:50:10.220743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 116/225] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:10 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:10.241992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:10.241992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:10.247457 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.247942 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.248370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.249090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:10.249543 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:10.249961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:10.276046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f53b0a64-168e-4636-832f-a78262e4ae57 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/ips" status: 200 len: 152 microversion: 2.20 time: 0.039661 Aug 29 22:50:10.276759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 110/226] 10.222.0.52 () {60 vars in 1289 bytes} [Mon Aug 29 22:50:10 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:50:11.231170 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:11.231766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:11.238437 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.238915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.239345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.240027 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:11.240474 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:11.240940 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:11.381509 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:11.391833 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f65eeef4-c7a3-4bec-b336-d05f40657243 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.164438 Aug 29 22:50:11.392416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 117/227] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:11 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:12.416501 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:12.418368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:12.427496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.428869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.429792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.431058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:12.432042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:12.432511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:12.437465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:12.619450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:12.627188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-327745cc-e2b5-4ba0-9208-6df8f4b04def tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.216428 Aug 29 22:50:12.627753 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 111/228] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:12 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:13.178751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:13.179282 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.188202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.188202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.188202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.188202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.188567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.188567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.215151 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-81f78938-c620-442b-8628-f2f8081a1ce4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/ips" status: 200 len: 146 microversion: 2.1 time: 0.040313 Aug 29 22:50:13.223064 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 118/229] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:50:13 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:13.527974 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:13.528520 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.536269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.536844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.537288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.537988 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.538438 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.538861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.561973 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lazy-loading 'flavor' on Instance uuid a1d449df-3756-44b7-b3a5-12ff3702f6bb {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:50:13.650044 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:13.651039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:13.670159 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.671353 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.672075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.673300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:13.673863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:13.674493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:13.680455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=94 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:13.870291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:13.878059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3d4fe4d2-9b18-40d2-a529-032bd6cfb4c5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.232765 Aug 29 22:50:13.879205 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 119/230] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:13 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:14.207792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3c977e07-faca-455b-8693-a80b365013d6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/action" status: 202 len: 0 microversion: 2.20 time: 0.683117 Aug 29 22:50:14.216095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 112/231] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Aug 29 22:50:13 2022] POST /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:50:14.219224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:14.219951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:14.232477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.233214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.233738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.234701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.235342 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.236553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.443589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:14.453791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:14.455882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:14.457363 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7cd9d523-169f-4177-b9b1-77bd4808aa22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.241964 Aug 29 22:50:14.457924 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 120/232] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:14 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:14.900913 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:14.902266 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:14.904438 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=30 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:14.916553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.917337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.917945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:14.921633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:14.922312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:14.922990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.100870 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:15.129762 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cc4caf55-0008-4c27-a6ee-e15c31440a5a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.233101 Aug 29 22:50:15.130468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 113/233] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:14 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:15.481034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:15.481698 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:15.488685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.489252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.489673 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.490386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:15.490822 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:15.491245 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:15.639255 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:15.651916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:15.653448 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:15.654613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f930c285-615e-4117-a590-c18c85bc5552 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.177945 Aug 29 22:50:15.655341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 121/234] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:15 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:16.154243 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:16.155997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:16.163450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.171763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.171763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.171763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.171763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.172310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.323313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:16.335226 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-44343da6-21e0-4d28-aa47-bae6847851a3 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.184973 Aug 29 22:50:16.335819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 114/235] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:16 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:16.381065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33d7a196-4634-44f0-9fe3-a8f6f5d32e86"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:16.383462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:16.389611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.390089 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.390514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.391205 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.391655 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.392070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.679998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:16.680593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:16.686754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.687228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.687704 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.688389 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:16.688873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:16.689301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:16.830923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:16.838928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:16.840340 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:16.841498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bb9fdfb6-6d91-4dec-b24b-20176b10cc5b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.166079 Aug 29 22:50:16.842049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 115/236] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:16 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:50:17.240955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7f5940a8-062b-4495-9c09-f46c059eb29f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.864822 Aug 29 22:50:17.244294 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 122/237] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:50:16 2022] POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-volume_attachments => generated 194 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:17.361425 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:17.361425 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:17.371819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.372610 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.373806 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.374864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.376426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.377124 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.539922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:17.553102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-00db0e00-d6cf-42cc-b149-ffe5b8ea7650 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.198815 Aug 29 22:50:17.555577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 116/238] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:17 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:17.867470 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:17.868176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:17.875669 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.876455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.876814 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:17.877452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:17.877900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:17.878386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:18.013182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:18.022159 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:18.023581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:18.024762 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7af0ad3b-dfe7-4d05-a62a-d4bce022eb6c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.162854 Aug 29 22:50:18.025320 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 123/239] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:17 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:50:18.576619 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:18.580584 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:18.585007 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:18.585851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:18.586434 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:18.587592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:18.588035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:18.588604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:18.732599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:18.741199 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-eb83e442-6586-4236-aff6-8efb01588428 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.168601 Aug 29 22:50:18.741766 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 117/240] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:18 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:19.049450 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:19.050153 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:19.057709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.058192 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.058636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.059314 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.059931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.060356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.205970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:19.215039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:19.216465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:19.217636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-354c4d64-47d8-4c1e-9142-23fe736653a9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.172179 Aug 29 22:50:19.218188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 124/241] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:19 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:19.762468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:19.763738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:19.769242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.769776 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.770203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.770884 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:19.771332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:19.771747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:19.911817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:19.938462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2071d453-f412-41e7-b01c-f41b43213580 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.179796 Aug 29 22:50:19.939047 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 118/242] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:19 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:20.241745 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:20.242449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:20.249108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.249559 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.249982 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.250662 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.251106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.251523 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.398451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:20.412603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:20.415150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:20.417127 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7749bf32-4f9d-4070-a61f-fae1847bd9d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.179857 Aug 29 22:50:20.418027 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 125/243] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:20 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:20.963929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:20.964430 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:20.973152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.973152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.973152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:20.973152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:20.979506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:20.979506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.107794 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:21.116014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-54758686-7e2a-4023-8d2f-5164d7e00c13 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.155934 Aug 29 22:50:21.116575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 119/244] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:20 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:21.442211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:21.442818 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:21.449392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.449864 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.450291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.451061 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:21.451504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:21.451921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:21.591718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:21.600412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:21.602055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:21.603275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5f359c23-bc16-4279-9f56-6ff9c620bcdc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.165770 Aug 29 22:50:21.603904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 126/245] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:21 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:22.143337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:22.144070 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:22.152398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.153239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.153727 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.154453 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.154871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.155288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.299437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:22.307840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d6d44005-0b8f-4d3c-bcd7-72530a0a8150 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.169461 Aug 29 22:50:22.308414 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 120/246] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:22 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:22.634745 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:22.635442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:22.642743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.643309 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.643960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.645178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:22.645462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:22.645916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:22.793918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:22.803069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:22.804555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:22.805931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0fabf3a5-6648-4771-8137-2cefae071fd1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.175884 Aug 29 22:50:22.806479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 127/247] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:22 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:23.330705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:23.331309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:23.338194 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.338569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.338997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.339686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.340203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.340540 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.474658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:23.482529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3fdc20b6-feac-4dd8-be3a-88ff4ae0282d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.155977 Aug 29 22:50:23.483067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 121/248] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:23 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:23.829990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:23.830941 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:23.845012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.845517 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.846156 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:23.847047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:23.848387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:23.848879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.025040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:24.036047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:24.037596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:24.039503 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-58c07bbe-79c3-470b-854c-093d35fdf42a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.213431 Aug 29 22:50:24.040069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 128/249] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:23 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:24.504848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:24.505629 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:24.511618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.512088 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.512691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.513433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:24.513877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:24.514368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:24.667905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:24.676920 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c0b44f08-f746-46c1-a99a-75945a40b653 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.176823 Aug 29 22:50:24.678073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 122/250] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:24 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:25.062826 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:25.063485 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:25.084658 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.085509 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.085951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.086659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.087116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.087539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.253343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:25.264030 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:25.265512 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:25.266682 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3df56b31-3821-465f-9219-122a03ddb46e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.208020 Aug 29 22:50:25.271242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 129/251] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:25 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:25.702854 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:25.703468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:25.710681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.711184 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.711698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.712352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.712838 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.713319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:25.871673 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:25.882309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-68d7f839-0a90-4672-879d-a956356fb2bb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.182601 Aug 29 22:50:25.882720 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 123/252] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:25 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:25.952704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-dac1dbdc-f169-42b0-854f-d76998025c00 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:25.965798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dac1dbdc-f169-42b0-854f-d76998025c00 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:25.966293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dac1dbdc-f169-42b0-854f-d76998025c00 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:25.966727 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dac1dbdc-f169-42b0-854f-d76998025c00 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.034314 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dac1dbdc-f169-42b0-854f-d76998025c00 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Going to try to stop instance {{(pid=139066) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 22:50:26.208422 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-dac1dbdc-f169-42b0-854f-d76998025c00 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.259626 Aug 29 22:50:26.211965 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 130/253] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:50:25 2022] POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:50:26.219325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:26.219981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:26.226026 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.226506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.226937 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.227622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.228140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.228480 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.293078 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:26.293982 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:26.300256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.301375 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.301919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.302882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.303411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.303896 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.398351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:26.407166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d63d6b7c-d86f-4f9d-bfdc-060780f7c10c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.191881 Aug 29 22:50:26.414402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 124/254] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:26 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:26.514097 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:26.524202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:26.525784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:26.527806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ac81e12e-b01a-47ed-a29e-5992d93639d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.242426 Aug 29 22:50:26.528288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 131/255] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:26 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:50:26.908005 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:26.908626 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:26.915338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.915871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.916345 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:26.917306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:26.921861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:26.921861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.056456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:27.058690 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:27.064991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bd8ee68b-c3a4-4fea-88ea-57f3b76ade93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1502 microversion: 2.1 time: 0.161089 Aug 29 22:50:27.065558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 125/256] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:26 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:27.086521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6b2777e6-afab-48a2-9308-9afb1ec4dc2c"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:27.088947 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.095399 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.095884 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.096376 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.097103 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.098364 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.098806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.284333 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] HTTP exception thrown: Cannot 'attach_volume' instance 946259ef-7337-4d98-9db7-9746c01d05c6 while it is in vm_state rescued Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Request method failure captured: Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: POST /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6/os-volume_attachments HTTP/1.1 Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 74 Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI_fx_ax7hXaVFnEIBOJPme5Yx-yHAOZEe7ob7RyetMxYxlOOq1u_Vs5fNJRAziZfgejU9-7rcscOUfjEh4uk-HAA3fex7iX8gvxmh5D1Slue9mJZCfARw4zI6mr2xg0Rf8e8bZRPhXgtGx4NduV7AOki27W8KNUFzfDUXD-wgvd10 Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:50:27.286656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 53f9f8eb7a20431ca0d679af45946bce Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {"volumeAttachment": {"volumeId": "6b2777e6-afab-48a2-9308-9afb1ec4dc2c"}} Aug 29 22:50:27.288204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Cannot 'attach_volume' instance 946259ef-7337-4d98-9db7-9746c01d05c6 while it is in vm_state rescued Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'server_id': '946259ef-7337-4d98-9db7-9746c01d05c6', 'body': {'volumeAttachment': {'volumeId': '6b2777e6-afab-48a2-9308-9afb1ec4dc2c'}}} Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 946259ef-7337-4d98-9db7-9746c01d05c6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:50:27.289069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 946259ef-7337-4d98-9db7-9746c01d05c6 while it is in vm_state rescued Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:50:27.290418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:50:27.291743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:50:27.291743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:50:27.291743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 946259ef-7337-4d98-9db7-9746c01d05c6 while it is in vm_state rescued Aug 29 22:50:27.291743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:50:27.291743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Returning 409 to user: Cannot 'attach_volume' instance 946259ef-7337-4d98-9db7-9746c01d05c6 while it is in vm_state rescued {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:50:27.291743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b80eac79-720b-43dd-8c42-609f81768294 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.206388 Aug 29 22:50:27.291743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 132/257] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:50:27 2022] POST /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6/os-volume_attachments => generated 152 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 22:50:27.297987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:27.298511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.305458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.305942 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.306368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.307053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.307500 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.313742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.429801 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:27.430409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.437699 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.438192 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.439020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.439453 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.440072 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.440500 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.598523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d2b970ec-304c-4a2e-b85a-0e31a607b4f6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6/action" status: 202 len: 0 microversion: 2.1 time: 0.303459 Aug 29 22:50:27.624350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 126/258] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:50:27 2022] POST /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:50:27.624683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:27.624832 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:27.624832 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.624996 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:27.624996 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b4733a30-4474-4382-a81e-ae96aa0833e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.189697 Aug 29 22:50:27.624996 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 133/259] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:27 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:27.633048 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:27.633667 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:27.635136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.636031 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.636617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.637450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.641214 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.642144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.650881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.650881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.651080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.651783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:27.652242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:27.652673 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:27.807939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:27.818110 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:27.819668 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:27.824126 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-25a689d6-6cf8-4209-8c8d-4096fe433ffe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.218732 Aug 29 22:50:27.824126 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 127/260] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:27 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:28.075074 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:28.083465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9fa99fa4-be9f-4bc3-90c1-aa9f67330718 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1510 microversion: 2.1 time: 0.454174 Aug 29 22:50:28.084024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 134/261] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:27 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1510 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:28.639381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:28.641277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:28.645994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.646495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.647080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.647770 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.648369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.648805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.829160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:28.839966 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-319321d1-4c54-455d-8621-5844a352041f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.205298 Aug 29 22:50:28.841130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 128/262] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:28 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:28.859111 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:28.859717 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:28.872155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.872155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.872155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:28.872155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:28.872454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:28.872549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.021081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:29.058600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:29.061057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:29.064313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-24fab5da-8d53-455b-a782-6b97cf840c84 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.223272 Aug 29 22:50:29.067822 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 135/263] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:28 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:29.104570 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:29.105451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:29.111833 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.112684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.113773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.114751 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.115448 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.116107 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.272296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:29.280630 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1e6d1a1b-5fc0-4194-8888-daf5aec6cda9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1510 microversion: 2.1 time: 0.179751 Aug 29 22:50:29.281228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 129/264] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:29 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:29.862600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:29.863176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:29.870934 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.871699 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.872136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:29.872970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:29.873423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:29.873842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.012386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:30.021796 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-080bcf9d-dbd4-480a-8439-02ab8e9528b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.163117 Aug 29 22:50:30.036457 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 136/265] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:29 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:30.108060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:30.109178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:30.116261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.116687 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.117158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.117865 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.118314 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.118737 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.303978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:30.304963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:30.311822 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.312414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.312953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.313878 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:30.314442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:30.315027 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:30.321665 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:30.331745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:30.333642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:30.334999 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fb9e6ff3-0a17-4883-89ee-08a2a1b414af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.231356 Aug 29 22:50:30.335622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 130/266] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:30 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:30.562327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:30.570593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-594ff836-57f7-4ec2-8942-5decf3fcc665 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1510 microversion: 2.1 time: 0.271602 Aug 29 22:50:30.571167 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 137/267] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:30 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1510 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:31.043583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:31.044398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:31.050657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.051286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.051730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.052479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.052897 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.053493 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.322600 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:31.331196 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3cb03ba2-ea37-4198-8714-3421ffa5264e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.291539 Aug 29 22:50:31.335062 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 131/268] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:31 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:31.359487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:31.360747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:31.367648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.368351 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.368826 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.369533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.369989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.370408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.518611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:31.528404 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:31.529932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:31.531234 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-44539c33-6585-4998-b789-5a921ab095fb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1746 microversion: 2.20 time: 0.176578 Aug 29 22:50:31.531784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 138/269] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:31 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1746 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:31.591684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:31.602320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:31.602320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.602320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.602320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.602814 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:31.602814 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:31.602814 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:31.745883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:31.754301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-113abe53-2c50-408e-bf00-2dff369fcbef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1516 microversion: 2.1 time: 0.166533 Aug 29 22:50:31.754950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 132/270] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:31 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:32.356453 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:32.357334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:32.365459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.366048 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.366481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.367507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.373813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.373813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.553896 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:32.559207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:32.559812 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:32.563560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-fcf560eb-448a-4340-95f6-f1be7f48ebfd tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.211646 Aug 29 22:50:32.574884 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.575597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.576247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.577185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:32.577829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:32.578442 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:32.580007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 139/271] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:32 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:32.723960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:32.731893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:32.736855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:32.736855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-840dab68-8fc2-4c6a-85b2-98df001d11af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1746 microversion: 2.20 time: 0.179918 Aug 29 22:50:32.736855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 133/272] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:32 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1746 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:33.587888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:33.588505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:33.595955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.596444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.596921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.598182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.598649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.599173 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.734058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:33.742875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f121f13e-1246-4c40-861c-898fe93e1f10 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.158997 Aug 29 22:50:33.743445 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 140/273] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:33 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:33.758769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:33.759371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:33.765380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.765918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.766350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.767122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:33.767572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:33.767993 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:33.909336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:33.918177 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:33.919632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:33.929237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-87585636-0dc5-4c50-85cb-424aa10023f3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1746 microversion: 2.20 time: 0.166114 Aug 29 22:50:33.929237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 134/274] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:33 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:50:34.439099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-16a0b324-83f8-4395-adf4-136dc668ff8f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'create', calling method: .version_select at 0x7efc649aef70>, body: {"keypair": {"name": "tempest-keypair-178879431", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUzcXwrqQc2LFm9QDF2HwWB1pTHFpYrvaeMuZI3mWYtjlK4gx62w3myO5YbsW6zqeDOUN10lUIaIcxxp61bIoljOuVFZzA8FJ1i91Zxy5Ua+ZKsGQ1FIAT0n+92EmH+tg=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:34.465155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-16a0b324-83f8-4395-adf4-136dc668ff8f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:50:34.471176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-16a0b324-83f8-4395-adf4-136dc668ff8f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for user 53f9f8eb7a20431ca0d679af45946bce and project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:50:34.575773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1894430796", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "networks": [{"uuid": "9653652e-3745-4151-94b4-45dd87562ee4"}]}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:34.632008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] validate_networks() for [('9653652e-3745-4151-94b4-45dd87562ee4', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:50:34.664409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-16a0b324-83f8-4395-adf4-136dc668ff8f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.229024 Aug 29 22:50:34.665964 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 141/275] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:50:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:34.764629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:34.765306 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:34.772536 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.773176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.780597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:34.780597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:34.780597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:34.780597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.012562 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:35.027542 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5291c66b-ad1a-4be5-b3df-97d482de0d83 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.266774 Aug 29 22:50:35.028426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 142/276] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:34 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:35.050468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:35.056335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:35.060426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.060945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.061521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.062256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.062705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.063301 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.416567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:35.428700 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:35.430349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:35.431654 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9bd562fa-5189-44ec-a74a-35bdc7118f34 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.401252 Aug 29 22:50:35.432610 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 143/277] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:35 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:35.449742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-1c5f540a-757a-42da-af6d-3366a33e6155 req-15cca80e-63c3-46d1-8840-d047c323403c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d449df-3756-44b7-b3a5-12ff3702f6bb", "name": "network-vif-plugged", "status": "completed", "tag": "d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:35.462925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1c5f540a-757a-42da-af6d-3366a33e6155 req-15cca80e-63c3-46d1-8840-d047c323403c service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.463397 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1c5f540a-757a-42da-af6d-3366a33e6155 req-15cca80e-63c3-46d1-8840-d047c323403c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.463824 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1c5f540a-757a-42da-af6d-3366a33e6155 req-15cca80e-63c3-46d1-8840-d047c323403c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.480910 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:50:35.481443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:50:35.481978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:50:35.482449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:50:35.483087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:50:35.485109 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-1c5f540a-757a-42da-af6d-3366a33e6155 req-15cca80e-63c3-46d1-8840-d047c323403c service nova] Creating event network-vif-plugged:d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7 for instance a1d449df-3756-44b7-b3a5-12ff3702f6bb on hv-cinder-85426 Aug 29 22:50:35.491930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-1c5f540a-757a-42da-af6d-3366a33e6155 req-15cca80e-63c3-46d1-8840-d047c323403c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057912 Aug 29 22:50:35.492890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 144/278] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:35.511170 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.511766 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.512262 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.513669 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:35.514089 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:35.514507 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:35.576635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Getting quotas for project 4f38e29d63fd4d04984af578b1708e4a. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:50:35.587961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Getting quotas for user 9c3c51d98e274150933a1306f7747f42 and project 4f38e29d63fd4d04984af578b1708e4a. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:50:35.607671 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:50:35.611670 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:50:35.796567 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f5881203-63aa-4817-aba4-2e56953406c1 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.224568 Aug 29 22:50:35.797783 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 135/279] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:50:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:50:35.813587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0ac54f61-5d28-48f9-9494-34483c94fe0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:35.814443 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0ac54f61-5d28-48f9-9494-34483c94fe0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:35.932211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0ac54f61-5d28-48f9-9494-34483c94fe0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:35.954746 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0ac54f61-5d28-48f9-9494-34483c94fe0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1214 microversion: 2.1 time: 0.147726 Aug 29 22:50:35.960799 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 145/280] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:35 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1214 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:36.051394 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:36.052279 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:36.068315 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.071147 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.072218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.076740 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.077561 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.078166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.283441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:36.293239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-44c44057-b015-4236-8306-9067fa122baf tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.244750 Aug 29 22:50:36.304750 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 136/281] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:36 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:36.459198 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:36.459918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:36.469473 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.470355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.471007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.471983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:36.472618 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:36.473867 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:36.706299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:36.729814 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:36.737718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:36.743613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-baa7b87f-3436-4fb8-9634-523adef4ab49 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.288412 Aug 29 22:50:36.748861 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 146/282] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:36 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:50:36.982689 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5efad2dc-ed37-45b7-9b8a-eac0d021ee2b tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:36.984039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5efad2dc-ed37-45b7-9b8a-eac0d021ee2b tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.094421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5efad2dc-ed37-45b7-9b8a-eac0d021ee2b tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:37.108646 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5efad2dc-ed37-45b7-9b8a-eac0d021ee2b tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1214 microversion: 2.1 time: 0.131959 Aug 29 22:50:37.124547 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 137/283] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:36 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1214 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:37.342471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:37.402107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.402107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.402107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.402107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.402629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.402629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.402629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.607528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:37.621293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3938a68f-00a5-4403-ac65-d76a1b6c905e tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.302689 Aug 29 22:50:37.622437 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 147/284] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:37 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:37.776091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:37.776091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:37.792191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.792964 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.793502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:37.794459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:37.794988 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:37.795783 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.096994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:38.106380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:38.107810 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:38.108997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2e29ab3f-fd4d-4c49-a4ad-f4836ec6c2fd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.339880 Aug 29 22:50:38.109734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 138/285] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:37 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:38.135817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:38.136387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:38.138628 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:38.258591 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.258591 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.258591 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.258591 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.259783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.259783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.345693 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:38.364392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-acf9b32b-90fb-4a49-8613-107b043b4c51 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1218 microversion: 2.1 time: 0.231759 Aug 29 22:50:38.373878 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 148/286] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:38 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1218 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:38.643640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:38.649336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:38.656420 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.657169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.658508 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:38.662236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:38.662877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:38.665296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.003054 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:39.012152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e04dc6c8-1fdd-43b9-be72-104bf9ec9157 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.372492 Aug 29 22:50:39.013114 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 139/287] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:38 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:39.141970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:39.141970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:39.172821 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.180403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.182523 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.186589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.189234 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.194114 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.387510 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:39.389537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:39.398386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.399412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.400089 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.401085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:39.401903 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:39.402546 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:39.519789 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:39.527825 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:39.534209 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:39.536451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:39.541597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-63562a8f-a12a-4ce9-a87c-04cc6b2f0df2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.407125 Aug 29 22:50:39.542434 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 149/288] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:39 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:39.560563 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-02bc7dfa-016b-4d2e-8338-86df3c75a533 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1266 microversion: 2.1 time: 0.174178 Aug 29 22:50:39.570826 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 140/289] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:39 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:39.751674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-548768891", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e0df57fe-49a1-4753-930b-30f7d46d9482"}], "security_groups": [{"name": "tempest-securitygroup--1921636665"}], "key_name": "tempest-keypair-178879431", "user_data": "}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:40.042559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:40.043166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:40.049420 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.050089 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.050571 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.051588 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.052316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.052877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.196141 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:40.204711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-ef3aca2e-25ec-497b-abe8-b6ef1c010cec tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.166638 Aug 29 22:50:40.205302 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 141/290] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:40 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:40.578192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:40.579618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:40.602382 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.603541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.604243 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.605219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.605824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.606477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.871856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:40.885064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:40.886912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:40.888555 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6e458843-4b76-4995-95fe-e40a9a9918c9 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.315957 Aug 29 22:50:40.911883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 142/291] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:40 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:40.925177 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:40.929325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:40.953255 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.955019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.956984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.958848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:40.959352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:40.961948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:40.971277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:41.097803 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:41.115326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7ce964e1-9a12-43a2-8e6f-a10157408dfb tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1284 microversion: 2.1 time: 0.202564 Aug 29 22:50:41.133261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 143/292] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:40 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1284 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:41.233935 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:41.234662 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:41.253616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.254370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.255111 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.256079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.261109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.264409 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.591588 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:41.599966 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-754d988a-c9b0-42a2-940a-8ad8bab1d96f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1722 microversion: 2.1 time: 0.371949 Aug 29 22:50:41.604914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 144/293] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:41 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1722 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:41.919494 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:41.920390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:41.929182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.930053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.930715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:41.931678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:41.932351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:41.934961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.185055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:42.216172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:42.221278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:42.226529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0b095f2e-5b62-4a15-90ca-d2830d870b00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.317850 Aug 29 22:50:42.229406 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 145/294] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:41 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:42.245227 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:42.246241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:42.265943 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.268187 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.271386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.275799 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.276664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.277602 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.587095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:42.599786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d46deca4-7d0d-4d83-b00b-723a5c6986e4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.367991 Aug 29 22:50:42.602934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 146/295] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:42 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:42.627264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:42.629171 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:42.638650 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.639883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.640565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.645876 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.646583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.647342 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.848403 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:42.861579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e0726689-f6dc-496e-9aae-4fcd9651dbf2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1699 microversion: 2.1 time: 0.239810 Aug 29 22:50:42.862935 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 147/296] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:42 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1699 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:42.884592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0860f027-6704-4181-a575-37f8908d4452 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:42.900865 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0860f027-6704-4181-a575-37f8908d4452 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:42.901674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0860f027-6704-4181-a575-37f8908d4452 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:42.902339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0860f027-6704-4181-a575-37f8908d4452 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:42.978105 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0860f027-6704-4181-a575-37f8908d4452 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Going to try to start instance {{(pid=139065) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 22:50:43.249619 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0860f027-6704-4181-a575-37f8908d4452 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.370100 Aug 29 22:50:43.250779 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 148/297] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:50:42 2022] POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:50:43.258138 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-0fc4c4e6-1203-43ea-995a-011f31074c05 req-7b351e1a-768b-421e-976d-3a2b3ceb85d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cad6be4f-2566-4c5e-bf34-b209c3fd086c", "tag": "ee97e81f-a560-4212-bbef-ab1ff649f524"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:43.271843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0fc4c4e6-1203-43ea-995a-011f31074c05 req-7b351e1a-768b-421e-976d-3a2b3ceb85d7 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.272565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0fc4c4e6-1203-43ea-995a-011f31074c05 req-7b351e1a-768b-421e-976d-3a2b3ceb85d7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.273174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0fc4c4e6-1203-43ea-995a-011f31074c05 req-7b351e1a-768b-421e-976d-3a2b3ceb85d7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.286515 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-0fc4c4e6-1203-43ea-995a-011f31074c05 req-7b351e1a-768b-421e-976d-3a2b3ceb85d7 service nova] Creating event network-changed:ee97e81f-a560-4212-bbef-ab1ff649f524 for instance cad6be4f-2566-4c5e-bf34-b209c3fd086c on hv-cinder-85426 Aug 29 22:50:43.292082 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-0fc4c4e6-1203-43ea-995a-011f31074c05 req-7b351e1a-768b-421e-976d-3a2b3ceb85d7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039621 Aug 29 22:50:43.294011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 149/298] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:43.299882 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.300571 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.307367 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.307856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.308283 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.309016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.309474 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.310495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.486205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:43.508549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:43.516625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:43.518129 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f8b3c059-6939-486c-a9ec-e1af13106f2f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.222721 Aug 29 22:50:43.520043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 150/299] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:43.534192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.537791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.552483 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.553035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.553478 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.556213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.559426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.561686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.879100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:43.890877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d7cdc530-50ac-46d3-b0b8-65047e32bf31 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1708 microversion: 2.1 time: 0.367334 Aug 29 22:50:43.892319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 151/300] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1708 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:43.898946 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:43.899813 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:43.907309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.908122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.908954 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:43.909772 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:43.910322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:43.911778 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.149268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:44.159757 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e49f37b8-b4c9-4f6b-ba61-f1849802007a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.266026 Aug 29 22:50:44.162292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 152/301] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:43 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:44.200961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] validate_networks() for [('e0df57fe-49a1-4753-930b-30f7d46d9482', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:50:44.547475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:44.548212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:44.555801 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.558875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.558875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.558875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.558875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.559239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.750463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:44.776572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:44.776572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:44.776572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-02aac037-8cfd-4cf9-a7bb-770c459d3cf2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.220763 Aug 29 22:50:44.776929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 153/302] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:44 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:50:44.917716 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:44.918960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:44.928594 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.929451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:44.931851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:44.932516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:44.933250 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.131051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:45.142604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0f66afcb-ccb3-4633-ac79-2327e605519b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1708 microversion: 2.1 time: 0.229717 Aug 29 22:50:45.144032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 154/303] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:44 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1708 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:45.183987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.184617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.188765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:45.203923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.204560 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.204946 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.205761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.209773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.210426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.220909 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:50:45.222164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:50:45.223313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:50:45.224100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:50:45.224755 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:50:45.236272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.236954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.237491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.238415 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.239700 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.240520 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.267772 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:50:45.273826 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Getting quotas for user 53f9f8eb7a20431ca0d679af45946bce and project 52aad64da33c4a48aa9eb7e325c5669b. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:50:45.289840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:50:45.292903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:50:45.522143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:45.529694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7e96ea8a-ba72-4d3d-86e9-c8f642d7b5bf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.350083 Aug 29 22:50:45.530292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 155/304] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:45.745307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ef83a78b-50bc-4db9-9163-23aa82ec19b5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.006294 Aug 29 22:50:45.746364 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 150/305] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:50:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 6008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:50:45.767564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f4110577-dec9-4fdf-91e8-81ac90b4f7fa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.768983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f4110577-dec9-4fdf-91e8-81ac90b4f7fa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.791718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:45.796217 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:45.797147 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:45.811569 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.814262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.814262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.814600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:45.815486 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:45.816286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:45.869831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f4110577-dec9-4fdf-91e8-81ac90b4f7fa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:45.880046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f4110577-dec9-4fdf-91e8-81ac90b4f7fa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1244 microversion: 2.1 time: 0.119738 Aug 29 22:50:45.883784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 156/306] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1244 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:46.068833 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:46.077950 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:46.079699 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:46.081182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cebcbfac-bc4b-4af9-9701-8b5286f49957 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.292300 Aug 29 22:50:46.084864 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 151/307] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:45 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:46.164810 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.166422 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.173051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.173615 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.174109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.175080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.175676 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.176581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.327361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:46.336968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f93ea11a-c233-4ebd-bc66-37500be1ac86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1708 microversion: 2.1 time: 0.176826 Aug 29 22:50:46.337529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 157/308] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1708 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:46.552612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.553248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.559702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.560184 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.560612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.561327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.561775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.562222 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.699723 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:46.719266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ca48d026-789f-4cfc-9d52-5ef58656559c tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.160855 Aug 29 22:50:46.719266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 152/309] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:46.907695 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:46.908689 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:46.918542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.919356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.920014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:46.920948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:46.921550 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:46.921943 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.000706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:47.009727 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7ae36834-49f7-4824-852f-c27542e3d642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1248 microversion: 2.1 time: 0.106000 Aug 29 22:50:47.010297 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 158/310] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:46 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1248 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:47.105784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.106708 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.113934 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.114979 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.121010 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.122028 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.122719 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.123378 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.304756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:47.307798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=100 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:47.318586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:47.321126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:47.323426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-37279344-3c8b-4285-a06c-a15968077319 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.221344 Aug 29 22:50:47.324368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 153/311] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:47.359419 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.367583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.367583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.368287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.368835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.369787 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.370445 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.371284 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.572381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:47.587168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-813dac6e-6665-47d2-9689-74b96698c5b8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1708 microversion: 2.1 time: 0.227009 Aug 29 22:50:47.588477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 159/312] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1708 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:47.742994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:47.750218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:47.779130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.784530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.785935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.787037 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:47.787558 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:47.788379 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:47.997024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:48.006632 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-66cfaa84-989b-4a09-bb8e-0b5d81f1ef21 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.269285 Aug 29 22:50:48.007237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 154/313] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:47 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:48.034337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.040201 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.043500 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.044334 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.044953 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.045937 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.046757 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.047394 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.075687 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:48.136176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:48.148937 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-21d25489-4e27-439c-b96a-2ced1fb8f403 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1240 microversion: 2.1 time: 0.118786 Aug 29 22:50:48.162417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 160/314] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1240 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:48.350753 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.351701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.358275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.358988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.359616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.360481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.361122 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.361646 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.556111 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:48.570128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:48.571888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:48.573223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-15107e84-01a3-439f-bc95-c8925273dae2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.229011 Aug 29 22:50:48.590129 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 155/315] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:48.609442 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:48.610812 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:48.617623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.624606 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.624606 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.624606 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:48.624606 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:48.625022 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:48.803725 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:48.815411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-91246382-0361-410f-9b98-e76e35c562e2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1708 microversion: 2.1 time: 0.209861 Aug 29 22:50:48.833355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 161/316] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:48 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1708 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:49.028295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.029159 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.037996 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.038490 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.039144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.040057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.040693 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.041210 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.173068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.173690 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.179625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.180115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.180550 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.181283 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.181738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.182161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.190385 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.198510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c06b0fed-88c5-4ef4-bd17-a5a4fb06322f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.174363 Aug 29 22:50:49.199073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 156/317] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:49.249421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.257803 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-90b39b53-58c1-4e73-a481-d7dfa82f7e74 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1296 microversion: 2.1 time: 0.088794 Aug 29 22:50:49.258370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 162/318] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1296 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:49.598054 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.598744 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.604738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.605221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.605651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.607343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.607343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.607343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.741789 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.751084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.752538 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:49.755793 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-febc62a5-22f9-468e-acb5-079ec787f391 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.159791 Aug 29 22:50:49.755793 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 157/319] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:49.847019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:49.848784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:49.862172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.878380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.878380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:49.878380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:49.878380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:49.878926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.116122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.128962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bf223f21-720b-475d-be37-cf5d6f9bce86 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1712 microversion: 2.1 time: 0.290248 Aug 29 22:50:50.146132 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 163/320] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:49 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1712 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:50.221443 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.222064 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.235081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.235588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.236261 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.237010 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.237650 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.242842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.281067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.281956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.309205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.309205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.309205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.309205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.309644 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.309644 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.441906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.452993 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bded6701-1a63-434d-890f-c1467d5f86f5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1296 microversion: 2.1 time: 0.170840 Aug 29 22:50:50.453748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 164/321] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1296 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:50.461441 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.473631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-61fe4179-1429-4368-948b-d1bc467caac3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.256257 Aug 29 22:50:50.474420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 158/322] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:50.778965 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:50.779612 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:50.785902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.786471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.786898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.788212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:50.788682 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:50.789119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:50.939750 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.953152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.953637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:50.954899 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3e2b5411-8d48-490b-83a8-410aaa25b6ca tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1741 microversion: 2.20 time: 0.179907 Aug 29 22:50:50.955518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 165/323] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:50 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1741 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:51.476476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.477718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.484615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.485460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.485915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.486608 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.487225 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.487656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.497304 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.498386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.510848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.514363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.514363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.517889 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.518603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.519261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.592807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:51.607743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ad39a997-f13b-4dbc-993d-a3d8330c56d5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1314 microversion: 2.1 time: 0.135993 Aug 29 22:50:51.608429 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 159/324] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1314 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:51.699565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:51.699565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fcecf86e-f681-4b11-a88c-1fd80313ba1e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.207984 Aug 29 22:50:51.700282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 166/325] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:51.979640 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:51.980247 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:51.986737 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.987229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.987836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:51.988497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:51.989265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:51.989632 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.357939 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:52.367288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:52.369188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:52.370369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8cee507e-2f4b-473a-9022-329cd6c72847 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1723 microversion: 2.20 time: 0.394646 Aug 29 22:50:52.370928 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 160/326] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:51 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:52.642099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:52.642099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:52.642099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.642099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.642853 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.642853 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.642853 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.642853 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.722961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:52.722961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:52.732556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.733077 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.733505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.734192 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:52.734636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:52.735054 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:52.808199 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:52.817745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-af81760e-fe4a-4e92-906a-0972d8abfaca tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.189431 Aug 29 22:50:52.818746 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 167/327] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:52 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:53.034097 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:53.042843 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2f5d170e-fa5d-42d3-972a-7a28ad9975a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.324650 Aug 29 22:50:53.043419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 161/328] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:52 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:53.394202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.397435 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.401319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.401878 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.402381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.403154 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.403671 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.404338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.455638 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-7b6f9eb8-be99-41f0-ba19-0ac289d75f29 req-7ad2e37f-559e-4267-b505-c12d37b350cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad6be4f-2566-4c5e-bf34-b209c3fd086c", "name": "network-vif-plugged", "status": "completed", "tag": "ee97e81f-a560-4212-bbef-ab1ff649f524"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:53.467714 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7b6f9eb8-be99-41f0-ba19-0ac289d75f29 req-7ad2e37f-559e-4267-b505-c12d37b350cb service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.468193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7b6f9eb8-be99-41f0-ba19-0ac289d75f29 req-7ad2e37f-559e-4267-b505-c12d37b350cb service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.468624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7b6f9eb8-be99-41f0-ba19-0ac289d75f29 req-7ad2e37f-559e-4267-b505-c12d37b350cb service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.486383 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-7b6f9eb8-be99-41f0-ba19-0ac289d75f29 req-7ad2e37f-559e-4267-b505-c12d37b350cb service nova] Creating event network-vif-plugged:ee97e81f-a560-4212-bbef-ab1ff649f524 for instance cad6be4f-2566-4c5e-bf34-b209c3fd086c on hv-cinder-85426 Aug 29 22:50:53.492272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-7b6f9eb8-be99-41f0-ba19-0ac289d75f29 req-7ad2e37f-559e-4267-b505-c12d37b350cb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042543 Aug 29 22:50:53.497623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 162/329] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:50:53.567178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:53.576673 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-c7c265fb-1181-475c-b86b-69272f6d49d9 req-83b01ef9-892e-483a-8626-d2a8e59b68ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3390881-2a07-4dfd-a9e3-d17318cf8441", "tag": "d5317cad-0fae-4b42-bce5-918aa12399dd"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:53.579683 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:53.583118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:53.585219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c8593365-4114-41fc-9777-93065dbd4820 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1723 microversion: 2.20 time: 0.194728 Aug 29 22:50:53.586805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 168/330] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:53.611554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c7c265fb-1181-475c-b86b-69272f6d49d9 req-83b01ef9-892e-483a-8626-d2a8e59b68ec service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.612101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c7c265fb-1181-475c-b86b-69272f6d49d9 req-83b01ef9-892e-483a-8626-d2a8e59b68ec service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.612538 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c7c265fb-1181-475c-b86b-69272f6d49d9 req-83b01ef9-892e-483a-8626-d2a8e59b68ec service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.633537 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-c7c265fb-1181-475c-b86b-69272f6d49d9 req-83b01ef9-892e-483a-8626-d2a8e59b68ec service nova] Creating event network-changed:d5317cad-0fae-4b42-bce5-918aa12399dd for instance d3390881-2a07-4dfd-a9e3-d17318cf8441 on hv-cinder-85426 Aug 29 22:50:53.638425 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-c7c265fb-1181-475c-b86b-69272f6d49d9 req-83b01ef9-892e-483a-8626-d2a8e59b68ec service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067328 Aug 29 22:50:53.639073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 163/331] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:53.843941 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:53.845868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:53.858660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.859532 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.861450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:53.863104 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:53.865096 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:53.880211 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.032791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.041968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bd73616b-eab1-44a7-a0f6-81b2d8cc8ccf tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.205344 Aug 29 22:50:54.042540 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 169/332] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:53 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:54.065061 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:54.065752 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:54.072381 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.072891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.073427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.074114 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.074562 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.074986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.217680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.226922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d2bb65a8-aa3b-448f-85dc-19134c80f671 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.166549 Aug 29 22:50:54.227491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 164/333] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:54 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:54.614982 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:54.616005 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:54.623385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.623867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.624299 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.625082 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:54.625532 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:54.625952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:54.777239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.785356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.787763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:54.788923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-97271a63-4c17-45ab-b870-ad439021d234 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1723 microversion: 2.20 time: 0.179142 Aug 29 22:50:54.794267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 170/334] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:54 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:55.063354 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.063988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.071397 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.072099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.072304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.073107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.073560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.073977 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.249437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.250043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.251564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:55.256882 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.257379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.257824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.258529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.258979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.259404 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.284592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=12 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:55.402010 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.409923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fce4dcc2-b46d-4622-b6c8-8e1fb6229fce tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.164328 Aug 29 22:50:55.410752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 171/335] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:55.425836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.434465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d696a446-c6f6-4766-89da-d49961df3b2e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.375055 Aug 29 22:50:55.435038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 165/336] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:55.811885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:55.812491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:55.818734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.822784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.822784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.822784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:55.822784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:55.823312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:55.875839 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=10 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:55.961579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.974094 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.975564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:55.976807 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8d8422e6-f516-4f4f-afab-01023aa80545 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1723 microversion: 2.20 time: 0.169244 Aug 29 22:50:55.977670 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 172/337] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:55 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:56.433009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:56.433683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:56.444133 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.444642 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.445116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.445835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.446294 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.446851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.467460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:56.470359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:56.477546 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.478136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.478662 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.481059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:56.481059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:56.481059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:56.661749 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:56.670863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c2127280-047b-422a-9eee-f27a9f5fa600 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.242918 Aug 29 22:50:56.673295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 166/338] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:56.746074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:56.756331 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6a001431-0cbc-4d92-a10a-cddf5012d956 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.293634 Aug 29 22:50:56.757300 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 173/339] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:57.001765 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:57.003140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:57.010055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.012464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.012464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.012464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.012464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.012806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.169960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:57.179062 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:57.180558 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:57.181847 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-faec8c96-0bcc-4b10-9d52-274355bc470b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1723 microversion: 2.20 time: 0.184133 Aug 29 22:50:57.182407 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 167/340] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:56 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:57.372598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-05b0ee46-5b0c-416d-8c00-6c6f0516d2a9 req-8b773d69-0419-4810-956f-6d46f522fe49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d449df-3756-44b7-b3a5-12ff3702f6bb", "name": "network-vif-unplugged", "status": "completed", "tag": "d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:57.384444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-05b0ee46-5b0c-416d-8c00-6c6f0516d2a9 req-8b773d69-0419-4810-956f-6d46f522fe49 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.385460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-05b0ee46-5b0c-416d-8c00-6c6f0516d2a9 req-8b773d69-0419-4810-956f-6d46f522fe49 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.385955 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-05b0ee46-5b0c-416d-8c00-6c6f0516d2a9 req-8b773d69-0419-4810-956f-6d46f522fe49 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.401355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-05b0ee46-5b0c-416d-8c00-6c6f0516d2a9 req-8b773d69-0419-4810-956f-6d46f522fe49 service nova] Creating event network-vif-unplugged:d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7 for instance a1d449df-3756-44b7-b3a5-12ff3702f6bb on hv-cinder-85426 Aug 29 22:50:57.407810 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-05b0ee46-5b0c-416d-8c00-6c6f0516d2a9 req-8b773d69-0419-4810-956f-6d46f522fe49 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043540 Aug 29 22:50:57.409691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 174/341] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:50:57.691806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:57.692799 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:57.700122 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.703944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.703944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.703944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.703944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.704445 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.789144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:57.790884 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:57.805177 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.806014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.806447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.807267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:57.807898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:57.809912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:57.943115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:57.953612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f533f7d9-3ac7-4321-ab53-4fe876915c80 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.265904 Aug 29 22:50:57.970312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 168/342] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:57 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:50:57.978119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:57.987505 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-da594d1d-dc4b-43a7-8585-7af568e5fe42 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.203790 Aug 29 22:50:57.989300 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 175/343] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:57 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:58.206633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:58.207345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:58.214180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.217847 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.218804 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.220849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.221193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.221851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.385583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:58.394450 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:58.396593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:58.397885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2d8dc99e-035d-4949-9194-7a17c715fa55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1726 microversion: 2.20 time: 0.196031 Aug 29 22:50:58.398558 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 169/344] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:50:58 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1726 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:50:58.421502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b34a759a-f2d7-4ccd-9d13-01c5d9c85545"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:50:58.424028 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:58.431072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.431558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.431982 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.432867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:58.433585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:58.434223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:58.969847 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:58.979434 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:58.986023 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:59.006179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.006834 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.007282 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.008007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.009256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.009256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.274248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:59.274248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-71ff5af5-3910-422f-b933-60029c34a32f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1314 microversion: 2.1 time: 0.296450 Aug 29 22:50:59.274248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 170/345] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:58 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:50:59.280634 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:50:59.281306 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:50:59.289967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.290469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.290931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.291628 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:50:59.292081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:50:59.292501 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:50:59.445410 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:50:59.447582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=100 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:50:59.454215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a93e16b2-8481-45fe-8756-744fe98b8f4c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.180379 Aug 29 22:50:59.455130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 171/346] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:50:59 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:00.001691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c65826f9-a84a-4535-83bd-c9e4161b143c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.584488 Aug 29 22:51:00.015523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 176/347] 10.222.0.52 () {62 vars in 1364 bytes} [Mon Aug 29 22:50:58 2022] POST /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments => generated 188 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:51:00.178007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:00.178638 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.188480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.189181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.189858 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.190737 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.191374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.191994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.238277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=139066) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 22:51:00.303571 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.304429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.311817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.312293 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.312749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.313433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.313921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.314338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.452109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:00.461502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d858f7f5-2832-48f1-87b7-bd66fde61e31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1498 microversion: 2.1 time: 0.162024 Aug 29 22:51:00.462358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 177/348] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1498 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:00.482103 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.482783 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.488734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.489231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.489666 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.490468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.490922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.491343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.570664 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-95f40686-2903-47e0-976b-6430de559217 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/action" status: 202 len: 0 microversion: 2.20 time: 0.397857 Aug 29 22:51:00.571291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 172/349] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Aug 29 22:51:00 2022] POST /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:51:00.579660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:00.580580 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:00.589089 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.589757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.590290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.591058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:00.591582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:00.592080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:00.641316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:00.651132 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6c784ee7-a1ff-4988-a434-e28a0d3dfd56 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.173054 Aug 29 22:51:00.651911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 178/350] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:00.742409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:00.751016 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:00.752452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:00.753641 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-458842ff-2443-4452-80f5-333fa42d6943 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1752 microversion: 2.20 time: 0.177960 Aug 29 22:51:00.754195 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 173/351] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:00 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:01.464530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.465250 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.473491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.474530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.475075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.475864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.476227 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.476647 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.512667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:51:01.674577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.675191 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.683764 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.684256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.684748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.685458 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.685907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.686319 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.877943 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:01.889563 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a237179a-80c4-4453-9046-39562b3ff378 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.219211 Aug 29 22:51:01.890372 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 174/352] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:01.897946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:01.898784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:01.909409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.910157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.910794 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.911836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:01.912155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:01.912758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:01.990890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fb1e1bd5-166a-4356-8a3e-75b547df718a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 204 len: 0 microversion: 2.1 time: 0.529731 Aug 29 22:51:01.992209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 179/353] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:51:01 2022] DELETE /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 0 bytes in 532 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:51:02.000842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:02.001577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:02.008552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.009158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.009540 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.010397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.010854 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.011273 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.151682 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:02.179857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:02.199318 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:02.201718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:02.202108 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f101977a-3864-479a-9810-b1bbcad37d87 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1504 microversion: 2.1 time: 0.204429 Aug 29 22:51:02.204568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-694ef110-0aff-42bd-a840-c55ecf29c410 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1752 microversion: 2.20 time: 0.311944 Aug 29 22:51:02.205296 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 175/354] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1752 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:02.209593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 180/355] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:01 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1504 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:02.912282 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:02.913171 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:02.919295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.919780 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.920276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:02.921068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:02.921647 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:02.922078 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.072769 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:03.080648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6181ddf7-1508-4b09-909e-22514e56486c tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.172903 Aug 29 22:51:03.081238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 176/356] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:02 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:03.228134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:03.229384 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:03.233551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:03.234582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:03.237095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.239561 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.239561 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.239561 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.240411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.241088 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.243242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.244033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.244263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.245389 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:03.245847 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:03.246355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:03.383548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:03.385312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:03.392670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:03.392877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2ffd03ec-5664-4516-8a9b-66093b584256 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1504 microversion: 2.1 time: 0.170712 Aug 29 22:51:03.393659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 181/357] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:03 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:03.394415 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:03.396300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-abf450e0-826b-4940-bc2c-3169efb8acab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1752 microversion: 2.20 time: 0.168937 Aug 29 22:51:03.408800 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 177/358] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:03 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:04.103213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:04.103807 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:04.109674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.110156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.110587 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.111272 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.111860 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.112272 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.251953 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:04.260546 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4175f662-222b-4c20-907a-43fda5d94c17 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.161174 Aug 29 22:51:04.261134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 182/359] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:04 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:04.415470 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:04.419499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:04.419761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:04.420013 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:04.423185 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.423661 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.424106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.424932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.425381 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.425798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.425910 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.426905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.427367 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.428154 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:04.428512 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:04.429003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:04.566468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:04.570121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:04.575018 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6ea15c02-1d05-4530-8793-049151080280 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1504 microversion: 2.1 time: 0.163739 Aug 29 22:51:04.575910 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 178/360] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:04 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:04.579484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:04.581207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:04.582641 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-33307e53-0a52-4b66-8213-1fecba6fc9a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1752 microversion: 2.20 time: 0.167169 Aug 29 22:51:04.583197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 183/361] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:04 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1752 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:05.281579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:05.282189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:05.289223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.289707 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.290134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.290817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.291267 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.291744 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.421638 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:05.429912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-909e56a9-3224-40e7-8348-44d716e756c8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.152227 Aug 29 22:51:05.430473 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 179/362] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:05 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:05.597041 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:05.597649 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:05.603816 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.604294 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.604748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.605441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.605675 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:05.605890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.606282 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:05.606391 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.612431 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.613039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.613498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.614232 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:05.614695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:05.615112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:05.744445 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:05.752254 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4697089c-8053-4d64-b585-b4eb784f487a tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1504 microversion: 2.1 time: 0.159205 Aug 29 22:51:05.752851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 184/363] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:05 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:05.762487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:05.772374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:05.773862 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:05.775006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b75676d5-81af-437c-b87b-ec22bdae4756 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1752 microversion: 2.20 time: 0.173316 Aug 29 22:51:05.775549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 180/364] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:05 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:06.451207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:06.451820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:06.459175 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.459661 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.460093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.461045 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.461686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.462417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.600675 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:06.609918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-26720d5b-b543-4ea8-9852-b95f77357007 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.162804 Aug 29 22:51:06.610552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 185/365] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:06 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:06.643015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-3dd7881b-dee4-4175-9fbe-0a741dacc5c5 req-1b0faf8b-4886-4964-9294-d2220ae34ed4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cad6be4f-2566-4c5e-bf34-b209c3fd086c", "name": "network-vif-deleted", "tag": "ee97e81f-a560-4212-bbef-ab1ff649f524"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:06.653307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-3dd7881b-dee4-4175-9fbe-0a741dacc5c5 req-1b0faf8b-4886-4964-9294-d2220ae34ed4 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.653819 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-3dd7881b-dee4-4175-9fbe-0a741dacc5c5 req-1b0faf8b-4886-4964-9294-d2220ae34ed4 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.654399 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-3dd7881b-dee4-4175-9fbe-0a741dacc5c5 req-1b0faf8b-4886-4964-9294-d2220ae34ed4 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.665639 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-3dd7881b-dee4-4175-9fbe-0a741dacc5c5 req-1b0faf8b-4886-4964-9294-d2220ae34ed4 service nova] Creating event network-vif-deleted:ee97e81f-a560-4212-bbef-ab1ff649f524 for instance cad6be4f-2566-4c5e-bf34-b209c3fd086c on hv-cinder-85426 Aug 29 22:51:06.670675 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-3dd7881b-dee4-4175-9fbe-0a741dacc5c5 req-1b0faf8b-4886-4964-9294-d2220ae34ed4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031448 Aug 29 22:51:06.671262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 181/366] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:06.774962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:06.775569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:06.783479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.783963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.793303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.793303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.793303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.793303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.800030 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:06.800971 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:06.809348 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.810177 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.810964 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.811663 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:06.812112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:06.812530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:06.855249 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:06.863079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e837e83c-1688-4294-aee1-0e189c1021b3 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1462 microversion: 2.1 time: 0.092437 Aug 29 22:51:06.865248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 186/367] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:06 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1462 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:06.976511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:06.985158 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:06.986598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:06.987790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-72a53962-bde2-49f6-97d9-ce66e23218a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1754 microversion: 2.20 time: 0.192549 Aug 29 22:51:06.988346 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 182/368] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:06 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1754 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:07.631083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:07.631685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:07.637694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.638169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.638596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.639280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.639727 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.640142 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.785087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:07.794059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5693b273-f0a1-4ca4-8d27-4aec2d111b93 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.166734 Aug 29 22:51:07.794607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 187/369] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:07 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:07.886816 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:07.887428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:07.900112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.901092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.901527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.902311 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.902776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.903175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.940589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:07.941251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:07.941695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:07.942873 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lazy-loading 'fault' on Instance uuid cad6be4f-2566-4c5e-bf34-b209c3fd086c {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:51:08.005318 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:08.013277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:08.013881 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:08.014747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2de73f0b-1291-4fb9-ab33-8c8aab338a9d tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 200 len: 1304 microversion: 2.1 time: 0.131815 Aug 29 22:51:08.015856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 183/370] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:07 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 1304 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:08.025264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.025750 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.026205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.026883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.027381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.027749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.170696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-c31fc05e-4a98-4185-b498-2c84ca99df94 req-5cff3096-adfa-4fcf-b113-28df647651af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3390881-2a07-4dfd-a9e3-d17318cf8441", "name": "network-vif-plugged", "status": "completed", "tag": "d5317cad-0fae-4b42-bce5-918aa12399dd"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:08.181227 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c31fc05e-4a98-4185-b498-2c84ca99df94 req-5cff3096-adfa-4fcf-b113-28df647651af service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.181670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c31fc05e-4a98-4185-b498-2c84ca99df94 req-5cff3096-adfa-4fcf-b113-28df647651af service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.181876 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:08.182109 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c31fc05e-4a98-4185-b498-2c84ca99df94 req-5cff3096-adfa-4fcf-b113-28df647651af service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.194646 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-c31fc05e-4a98-4185-b498-2c84ca99df94 req-5cff3096-adfa-4fcf-b113-28df647651af service nova] Creating event network-vif-plugged:d5317cad-0fae-4b42-bce5-918aa12399dd for instance d3390881-2a07-4dfd-a9e3-d17318cf8441 on hv-cinder-85426 Aug 29 22:51:08.195216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:08.196708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:08.197979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-df848883-c937-49f9-8c81-10b33d5aa05e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1754 microversion: 2.20 time: 0.188905 Aug 29 22:51:08.198531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 188/371] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:08 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1754 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:08.219916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-c31fc05e-4a98-4185-b498-2c84ca99df94 req-5cff3096-adfa-4fcf-b113-28df647651af service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050622 Aug 29 22:51:08.219916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 184/372] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:08.814805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:08.815319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:08.822166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.822649 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.826149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.826149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:08.826149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:08.826149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:08.954581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:08.963395 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1bbe011f-d01f-46b2-ae5c-87d2e7e7e838 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.152618 Aug 29 22:51:08.964002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 189/373] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:08 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:09.039650 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:09.040561 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: cad6be4f-2566-4c5e-bf34-b209c3fd086c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:09.047055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.047533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.047962 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.048654 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.049134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.049547 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.064187 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] HTTP exception thrown: Instance cad6be4f-2566-4c5e-bf34-b209c3fd086c could not be found. Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Request method failure captured: Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c HTTP/1.1 Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUK4OrkB_yXQqzCOcXuoLERbOCijv2lHuZpUFT5xmPlVOxjektL71CAQ3Fk0UwArW8-ss6An6DP8kMY59JpdbyklSp9mwFpVsjVSiJLfs0BY_GHMsSnpEHSWGhVsVI7RS4w7hCkadrIqjbKaN4N9NR4X6egF_Z3UldzuzDGihevyAlY Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 4f38e29d63fd4d04984af578b1708e4a Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesActionsTest-394148704 Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:51:09.066180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesActionsTest-394148704 Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 4f38e29d63fd4d04984af578b1708e4a Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesActionsTest-394148704 Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesActionsTest-394148704-project Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 9c3c51d98e274150933a1306f7747f42 Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesActionsTest-394148704-project Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance cad6be4f-2566-4c5e-bf34-b209c3fd086c could not be found. Aug 29 22:51:09.067743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'cad6be4f-2566-4c5e-bf34-b209c3fd086c'} Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cad6be4f-2566-4c5e-bf34-b209c3fd086c could not be found. Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:51:09.069589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cad6be4f-2566-4c5e-bf34-b209c3fd086c could not be found. Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cad6be4f-2566-4c5e-bf34-b209c3fd086c could not be found. Aug 29 22:51:09.070954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:51:09.073083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Returning 404 to user: Instance cad6be4f-2566-4c5e-bf34-b209c3fd086c could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:51:09.073927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c75090f5-5519-425a-8f8b-b8baac8dee5f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c" status: 404 len: 111 microversion: 2.1 time: 0.040305 Aug 29 22:51:09.074833 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 185/374] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:09 2022] GET /compute/v2.1/servers/cad6be4f-2566-4c5e-bf34-b209c3fd086c => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:51:09.189366 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1568156348", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "networks": [{"uuid": "9653652e-3745-4151-94b4-45dd87562ee4"}]}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:09.223456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:09.232880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:09.232880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.233778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.234455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.234797 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.236090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.236620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.237142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.245121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] validate_networks() for [('9653652e-3745-4151-94b4-45dd87562ee4', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:51:09.395449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:09.405381 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:09.406958 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:09.408239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-fbcebd3e-e27f-4f27-9efc-3c1003c08454 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.188775 Aug 29 22:51:09.409067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 186/375] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:09 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:09.877930 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:51:09.878806 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:51:09.879426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:51:09.879964 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:51:09.880419 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:51:09.909785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.910292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.910763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.911617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.912096 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.912631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.923791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:09.935247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Getting quotas for project 4f38e29d63fd4d04984af578b1708e4a. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:51:09.939395 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Getting quotas for user 9c3c51d98e274150933a1306f7747f42 and project 4f38e29d63fd4d04984af578b1708e4a. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:51:09.951603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:51:09.954387 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:51:09.985259 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:09.985581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:09.992703 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.993207 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.993642 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:09.994331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:09.994781 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:09.995206 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.066264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a32cfa3d-1bed-4828-9af2-9c7301929e12 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.880626 Aug 29 22:51:10.066977 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 190/376] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:51:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:51:10.078152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0fdc04b2-f3c9-4152-97a7-8ccfac89c24f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:10.079271 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0fdc04b2-f3c9-4152-97a7-8ccfac89c24f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:10.136463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0fdc04b2-f3c9-4152-97a7-8ccfac89c24f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:10.138022 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:10.144459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0fdc04b2-f3c9-4152-97a7-8ccfac89c24f tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1214 microversion: 2.1 time: 0.070160 Aug 29 22:51:10.145065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 191/377] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:10 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:10.146139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8d18f5e3-b9b0-43e7-a15e-0b3ddd7b1334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1370 microversion: 2.1 time: 0.165203 Aug 29 22:51:10.147439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 187/378] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:09 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:10.432553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:10.433308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:10.439573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.442234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.442234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.442234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:10.442234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:10.442714 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:10.591083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:10.603406 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:10.605519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:10.608003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-ad0d78a1-5c51-4ac2-8d67-f72bfdc31350 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.179225 Aug 29 22:51:10.608003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 192/379] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:10 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:11.168096 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:11.169504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:11.171009 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:11.171201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:11.179866 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.180359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.180868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.181506 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.182181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.182844 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.184979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:11.194755 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.195674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.195674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.196379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.196880 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.197284 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.262521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:11.272031 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1464b1e2-206f-41f2-a1b0-637b40fde743 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1218 microversion: 2.1 time: 0.111081 Aug 29 22:51:11.273162 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 188/380] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:11 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:11.418153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:11.425916 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7bc9b7b9-2bc9-4dfb-9b90-8a9404dff00a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1564 microversion: 2.1 time: 0.261888 Aug 29 22:51:11.426526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 193/381] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:11 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1564 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:11.453421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:11.453917 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:11.461987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.462534 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.463037 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.463957 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.464518 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.465191 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.470221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:11.559487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-03b85623-0103-44de-b5a0-c28c66aee91f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110351 Aug 29 22:51:11.560115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 189/382] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:51:11 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:11.630577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:11.636449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:11.638767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.639248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.639672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:11.640408 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:11.640890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:11.641305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.013090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:12.025330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:12.033056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:12.033056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-705f995f-2952-4c53-b5db-4edea4238c28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.405133 Aug 29 22:51:12.033056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 194/383] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:11 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:12.305529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:12.306817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:12.313829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.314631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.315275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.316172 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:12.316840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:12.317466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:12.403948 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:12.413300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5371040f-159e-4f4b-bf0b-580845ed6ec5 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.112718 Aug 29 22:51:12.417714 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 190/384] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:12 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:13.063195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:13.066677 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:13.079971 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.082096 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.082844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.106360 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.107532 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.109112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.109530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-0fc165d5-96e5-4479-9f28-33cc0d661157 req-9ce2deb6-c964-4de6-810d-6d3168b4374e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3390881-2a07-4dfd-a9e3-d17318cf8441", "tag": "d5317cad-0fae-4b42-bce5-918aa12399dd"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:13.121616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0fc165d5-96e5-4479-9f28-33cc0d661157 req-9ce2deb6-c964-4de6-810d-6d3168b4374e service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.122343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0fc165d5-96e5-4479-9f28-33cc0d661157 req-9ce2deb6-c964-4de6-810d-6d3168b4374e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.122949 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0fc165d5-96e5-4479-9f28-33cc0d661157 req-9ce2deb6-c964-4de6-810d-6d3168b4374e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.145990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-0fc165d5-96e5-4479-9f28-33cc0d661157 req-9ce2deb6-c964-4de6-810d-6d3168b4374e service nova] Creating event network-changed:d5317cad-0fae-4b42-bce5-918aa12399dd for instance d3390881-2a07-4dfd-a9e3-d17318cf8441 on hv-cinder-85426 Aug 29 22:51:13.171039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-0fc165d5-96e5-4479-9f28-33cc0d661157 req-9ce2deb6-c964-4de6-810d-6d3168b4374e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064890 Aug 29 22:51:13.171888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 191/385] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:13.437943 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:13.438410 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:13.471891 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:13.485568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:13.493682 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.495869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.497677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.499521 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:13.502291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:13.503670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:13.504471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f303b1bf-b5d7-4ec1-826b-58d87c825145 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.451970 Aug 29 22:51:13.507029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 195/386] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:13 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:13.508602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:13.685683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:13.695208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-30b65059-64af-43e8-87c0-e738a75e1f56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.261622 Aug 29 22:51:13.707020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 192/387] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:13 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:14.534232 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:14.534841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:14.546879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.546879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.546879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.546879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.547238 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.547238 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.732548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:14.734146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:14.748454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.750430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.750430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.757087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:14.757961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:14.758627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:14.900492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:14.919533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d3836e8e-40b3-4e48-ae03-df8c30abd661 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.195894 Aug 29 22:51:14.920696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 193/388] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:14 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:14.982775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:14.993831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:14.995241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:14.996466 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-190e12c6-3476-4c00-984f-613621a5e215 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.466260 Aug 29 22:51:14.997048 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 196/389] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:14 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:15.941564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:15.943257 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:15.950867 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.951686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.952144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:15.952891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:15.953746 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:15.954581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.037945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:16.037945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:16.039094 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:16.039216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.039216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.039216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.039216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:16.039559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:16.039559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:16.042839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-05aaa9f2-c040-4bc1-a8d3-8f9b7e05fc54 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.106659 Aug 29 22:51:16.043479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 194/390] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:15 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:16.221329 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:16.240525 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:16.243577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:16.250293 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3a79ceb3-e97e-4d01-a50b-0cd9d2187d7c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.226866 Aug 29 22:51:16.250293 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 197/391] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:16 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:17.063864 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:17.065824 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:17.074836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.075955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.076967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.078182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.079088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.079795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.175191 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:17.191093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cc8dc870-25d0-4657-b14e-e86594cd92ac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.131244 Aug 29 22:51:17.195856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 195/392] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:17 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:17.271540 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:17.272958 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:17.279796 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.280594 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.281415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.283094 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:17.285131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:17.285912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:17.582461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:17.593368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:17.594741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:17.596103 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-65e7dfb9-5379-434b-bd19-ab336d630f2c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.328604 Aug 29 22:51:17.596652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 198/393] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:17 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:18.212412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:18.215237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:18.229307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.230087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.230692 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.231574 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.232189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.234487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.423221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:18.432434 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3383a775-16da-4393-ba78-c27f7ea1f6a2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.224409 Aug 29 22:51:18.443016 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 196/394] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:18 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:18.622176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:18.622804 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:18.629911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.630640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.631609 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.632629 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:18.633048 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:18.633664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:18.812164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:18.824774 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:18.826898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:18.828542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-efc38f49-522f-4604-a634-67c208def3d0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.210869 Aug 29 22:51:18.829378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 199/395] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:18 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:19.454388 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:19.455068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:19.473577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.474136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.474521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.492329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.493350 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.510003 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.626286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:19.636425 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-558b8648-96cb-4902-8823-a9d50ef680cf tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.186125 Aug 29 22:51:19.642790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 197/396] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:19 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:19.860550 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:19.862306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:19.869738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.870493 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.871268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.872592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:19.873242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:19.873854 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:19.925417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:20.135869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:20.142786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=8 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:20.150183 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:20.154273 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:20.158737 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-80384f5d-8e67-4bc5-b578-3fe6d9f0e810 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.307003 Aug 29 22:51:20.159635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 200/397] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:19 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:20.667402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:20.668022 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:20.675128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.675884 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.676584 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.677490 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:20.678158 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:20.678744 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:20.810911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:20.819712 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c3be7777-a1d7-4526-bfc3-838197ce1e56 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1266 microversion: 2.1 time: 0.156303 Aug 29 22:51:20.823300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 198/398] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:20 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:21.185018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:21.190131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:21.194411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.194900 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.195334 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.196098 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.196493 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.196946 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.649190 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:21.649318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:21.651592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:21.652975 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5f1f665d-0903-4b52-9fd7-9f1b32fd5138 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.472232 Aug 29 22:51:21.658186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 201/399] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:21 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:21.842109 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:21.844788 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:21.851422 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.852210 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.854045 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:21.856193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:21.857016 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:21.857681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.059890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:22.074277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ec7e9c99-f12f-4d64-8e08-bfa8a11a5965 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1274 microversion: 2.1 time: 0.235490 Aug 29 22:51:22.074882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 199/400] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:21 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1274 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:22.679250 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:22.680445 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:22.688118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.691029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.696336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:22.696336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:22.696336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:22.696336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.003242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:23.015512 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:23.024599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:23.026107 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-323bd077-e3c2-4ccd-8904-5c1f4022db1d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.351237 Aug 29 22:51:23.027002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 202/401] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:22 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:23.095579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:23.097156 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:23.105025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.105751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.106817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.107931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:23.108599 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:23.109263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:23.377899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:23.387503 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cd7faca5-6ec5-4503-a7df-a899442602f2 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.295860 Aug 29 22:51:23.388163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 200/402] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:23 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:24.050711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:24.051554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:24.059490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.060289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.061158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.061955 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.062407 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.062834 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.280914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:24.294314 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:24.297370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:24.298549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-55baa566-7aac-41c5-b728-faff0a47b515 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.252388 Aug 29 22:51:24.299265 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 203/403] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:24 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:24.410098 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:24.411887 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:24.419243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.419949 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.420378 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.421108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:24.421788 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:24.422216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:24.667323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:24.673827 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-86d1deda-51aa-4b40-b788-1916d90a7fa8 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.267626 Aug 29 22:51:24.678399 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 201/404] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:24 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:25.323689 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:25.325026 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:25.331272 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.331759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.332503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.333173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.333625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.337795 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.481033 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:25.497178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:25.498625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:25.499798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2180e508-6b21-4134-b31b-e9d4ce227bc6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.181507 Aug 29 22:51:25.500347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 204/405] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:25 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:25.696806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:25.697420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:25.714902 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.715442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.716084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:25.717095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:25.717839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:25.718442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.149722 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:26.160806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b43d3de7-416d-4af3-abb7-5df0c2d7acae tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.469016 Aug 29 22:51:26.170285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 202/406] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:25 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:26.533764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:26.534529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:26.546500 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.550915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.551357 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.552094 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.552539 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.553067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.855383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:26.859813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-f612e6fa-854e-4a33-886a-35507bdb1576 req-1000f461-57b2-4a4e-a70a-6fb2adbaf817 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdff680e-99f7-4dfd-b6b2-fdd495d977dc", "tag": "9ca59c4a-73d7-4a73-8d8e-3b9185b2a763"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:26.893526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:26.900531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:26.903331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f612e6fa-854e-4a33-886a-35507bdb1576 req-1000f461-57b2-4a4e-a70a-6fb2adbaf817 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:26.904472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3bf31ee7-87aa-4247-acf8-fdf14e0a9f8e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.384065 Aug 29 22:51:26.905069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f612e6fa-854e-4a33-886a-35507bdb1576 req-1000f461-57b2-4a4e-a70a-6fb2adbaf817 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:26.905738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 205/407] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:26 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:26.906174 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f612e6fa-854e-4a33-886a-35507bdb1576 req-1000f461-57b2-4a4e-a70a-6fb2adbaf817 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:26.921181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-f612e6fa-854e-4a33-886a-35507bdb1576 req-1000f461-57b2-4a4e-a70a-6fb2adbaf817 service nova] Creating event network-changed:9ca59c4a-73d7-4a73-8d8e-3b9185b2a763 for instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc on hv-cinder-85426 Aug 29 22:51:26.951400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-f612e6fa-854e-4a33-886a-35507bdb1576 req-1000f461-57b2-4a4e-a70a-6fb2adbaf817 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104546 Aug 29 22:51:26.953291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 203/408] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:27.182563 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:27.183521 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:27.190013 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.190499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.191097 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.191889 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.192407 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.193173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.384360 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:27.394278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cc4a8c06-160a-4dff-9ddd-5b241cdb0e99 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.216118 Aug 29 22:51:27.401008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 206/409] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:27 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:27.932367 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:27.933886 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:27.942070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.942566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.943006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:27.945029 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:27.945653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:27.946083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.153015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:28.166725 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:28.171424 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:28.180361 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-de181c0c-fcc2-4ef5-838a-ec94e3d831b5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.253405 Aug 29 22:51:28.181259 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 204/410] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:27 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:28.417683 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:28.418498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:28.424939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.425942 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.427175 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.428860 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:28.431624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:28.431624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:28.622897 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:28.631910 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-526d32e9-6685-4d1e-a044-c3097f2353ee tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.218979 Aug 29 22:51:28.633081 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 207/411] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:28 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:29.205301 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:29.206832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:29.217093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.217844 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.219917 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.220846 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.221462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.222033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.499008 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:29.510189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:29.511762 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:29.513066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b5055d52-67b2-4e41-9c23-4010469b3265 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.312997 Aug 29 22:51:29.514358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 205/412] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:29 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:29.653592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:29.654150 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:29.664747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.665245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.665871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.666574 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:29.667014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:29.667429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:29.689278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:29.828205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:29.836980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-86d14808-bff8-4b68-85cd-b95530d250dd tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.187328 Aug 29 22:51:29.838946 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 208/413] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:29 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:30.552262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:30.559409 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:30.560823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:30.564103 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:30.572118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.572463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.574593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.575803 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.577566 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.578389 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.579123 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.579684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.581354 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.583516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:30.586991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:30.587170 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:30.847679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lazy-loading 'services' on Instance uuid 90821429-6373-4dcf-ac68-2af347d45eb1 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:51:31.057483 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:31.073065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:31.075007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:31.076334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4b3fa1bc-eb10-4f65-8fb5-715dcc2fe344 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.528032 Aug 29 22:51:31.077547 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 206/414] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:30 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:31.083694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:31.086106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:31.093466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.094254 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.095218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.096193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:31.096909 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:31.097863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:31.124379 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=100 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:31.174465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0a28fd41-fda1-4fbf-bdcb-b02c528a2c1d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-volume_attachments/33d7a196-4634-44f0-9fe3-a8f6f5d32e86" status: 202 len: 0 microversion: 2.1 time: 0.622149 Aug 29 22:51:31.180698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 209/415] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:51:30 2022] DELETE /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-volume_attachments/33d7a196-4634-44f0-9fe3-a8f6f5d32e86 => generated 0 bytes in 638 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:51:31.481346 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:31.496428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8ad2a0d0-cb65-4cb0-a0b6-cc130fdc3ade tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.415854 Aug 29 22:51:31.498616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 207/416] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:31 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:32.110858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:32.112966 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:32.122806 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.124038 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.125857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.127646 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.128750 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.129330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.379709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:32.394265 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:32.396006 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:32.398389 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a216ff38-853a-460a-ae62-a036aab7f9f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.294674 Aug 29 22:51:32.399431 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 210/417] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:32 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:32.519188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:32.519815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:32.528196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.529581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.530270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.531340 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:32.531796 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:32.532936 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:32.772875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:32.780946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0b7946cb-c371-41b6-bf71-76835dd034b4 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.266004 Aug 29 22:51:32.782161 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 208/418] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:32 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:33.422981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:33.423595 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:33.434358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.435691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.436965 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.438023 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.438637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.439217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.629263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:33.639489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:33.641820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:33.643557 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6b17d928-0046-4cff-9ea5-98d9c427068c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.225148 Aug 29 22:51:33.644452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 211/419] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:33 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:33.809365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:33.809365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:33.814757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.815368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.815465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.816106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:33.816623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:33.817084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:33.962106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:33.969891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-973eba76-0802-4a59-aece-0c3767f98b31 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.170252 Aug 29 22:51:33.970460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 209/420] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:33 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:34.669097 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.669620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:34.677505 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.678037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.678664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.679664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:34.679989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:34.680399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:34.879650 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:34.896841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:34.898464 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:34.899631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8e01a16e-6423-477f-9f8e-1b01151b7bfe tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.234699 Aug 29 22:51:34.900338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 212/421] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:34 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:34.993472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:34.993472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:35.001857 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.002720 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.003453 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.004414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:35.005058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:35.005627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:35.192169 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:35.204365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f3c88e0b-4302-4411-aabb-41cc3f1f1750 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.213867 Aug 29 22:51:35.228834 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 210/422] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:34 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:35.940957 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:35.942562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.008818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.008818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.008818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.008818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.009147 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.009147 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.202239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-36ac69ee-0d8f-471d-b2e5-6dec10643fe6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:36.212656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36ac69ee-0d8f-471d-b2e5-6dec10643fe6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.214997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36ac69ee-0d8f-471d-b2e5-6dec10643fe6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.214997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36ac69ee-0d8f-471d-b2e5-6dec10643fe6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.263922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-36ac69ee-0d8f-471d-b2e5-6dec10643fe6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Going to try to stop instance {{(pid=139066) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 29 22:51:36.293527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:36.314963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:36.316577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:36.321546 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-16a950f8-b24a-4cfa-bd9a-4e55fab10d85 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.387647 Aug 29 22:51:36.322071 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 213/423] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:35 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:51:36.334608 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:36.335437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.351526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.351953 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.366131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.370081 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.370081 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.370081 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.598547 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-36ac69ee-0d8f-471d-b2e5-6dec10643fe6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.399242 Aug 29 22:51:36.604604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 211/424] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:51:36 2022] POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:51:36.612515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:36.613567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:36.624587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.627626 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.628621 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.629583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:36.633490 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:36.634208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:36.639783 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:36.650443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-28bf1371-cbba-47fa-b25d-1eb34fa8aefe tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.327328 Aug 29 22:51:36.664608 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 214/425] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:36 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:37.110593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:37.121856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f1144abc-738b-46db-a0be-7c6ca724c543 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.515176 Aug 29 22:51:37.122440 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 212/426] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:36 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:37.349322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:37.351062 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:37.366428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.366939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.369330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.371604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.374800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.382504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.559766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-26b24a5d-e396-4bf3-9bc5-ec58fcba9085 req-0dfb51ae-291c-42d7-b466-f88ce16645da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d449df-3756-44b7-b3a5-12ff3702f6bb", "name": "network-vif-plugged", "status": "completed", "tag": "d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:37.591436 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-26b24a5d-e396-4bf3-9bc5-ec58fcba9085 req-0dfb51ae-291c-42d7-b466-f88ce16645da service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.592439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-26b24a5d-e396-4bf3-9bc5-ec58fcba9085 req-0dfb51ae-291c-42d7-b466-f88ce16645da service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.593704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-26b24a5d-e396-4bf3-9bc5-ec58fcba9085 req-0dfb51ae-291c-42d7-b466-f88ce16645da service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.621375 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-26b24a5d-e396-4bf3-9bc5-ec58fcba9085 req-0dfb51ae-291c-42d7-b466-f88ce16645da service nova] Creating event network-vif-plugged:d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7 for instance a1d449df-3756-44b7-b3a5-12ff3702f6bb on hv-cinder-85426 Aug 29 22:51:37.638420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-26b24a5d-e396-4bf3-9bc5-ec58fcba9085 req-0dfb51ae-291c-42d7-b466-f88ce16645da service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082122 Aug 29 22:51:37.642332 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 213/427] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:37.689334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:37.690941 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:37.706994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.708694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.710625 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.722019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:37.722859 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:37.729416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:37.737469 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:37.750198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:37.752056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:37.768410 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3c3a15a8-964a-4f4b-8e5c-11941358d39f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.408882 Aug 29 22:51:37.768410 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 215/428] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:37 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:37.981004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:38.002179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d13c7dc3-0344-4391-b700-d73da46c43c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.316138 Aug 29 22:51:38.002179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 214/429] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:37 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:38.152271 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:38.153345 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:38.166243 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.167437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.168925 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.170206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.171985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.173708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.458305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:38.468051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-87b250fd-9ce0-473e-87b6-26e310658170 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.320130 Aug 29 22:51:38.485199 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 216/430] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:38 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:38.783489 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:38.784234 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:38.800313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.806329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.806888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:38.807726 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:38.808409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:38.808950 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.015204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:39.022183 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.022905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:39.028417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:39.029456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.029932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.030141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:39.030353 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.031039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.031298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-88ee01f4-3261-4afb-9bd7-26c9b469d3ec tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.251821 Aug 29 22:51:39.031485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.031898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.032167 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 215/431] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:38 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:39.191771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:39.214764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f3ba9006-f6da-4443-b953-1cbe99e651f6 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.188475 Aug 29 22:51:39.214764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 217/432] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:39 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:39.495007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:39.495850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:39.505185 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.509019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.509524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.511917 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.512480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.514095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.679817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:39.692124 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-48dad8e9-2c4f-4bf3-9781-34e6b7c19f02 req-8b02ff68-b774-49c9-af86-c3f48ae86913 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdff680e-99f7-4dfd-b6b2-fdd495d977dc", "name": "network-vif-plugged", "status": "completed", "tag": "9ca59c4a-73d7-4a73-8d8e-3b9185b2a763"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:39.710095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4ddfa6f1-be98-43ab-beb4-9b73dea31172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.214806 Aug 29 22:51:39.710943 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 216/433] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:39 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:39.733541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-48dad8e9-2c4f-4bf3-9781-34e6b7c19f02 req-8b02ff68-b774-49c9-af86-c3f48ae86913 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:39.737952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-48dad8e9-2c4f-4bf3-9781-34e6b7c19f02 req-8b02ff68-b774-49c9-af86-c3f48ae86913 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:39.737952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-48dad8e9-2c4f-4bf3-9781-34e6b7c19f02 req-8b02ff68-b774-49c9-af86-c3f48ae86913 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:39.752188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-48dad8e9-2c4f-4bf3-9781-34e6b7c19f02 req-8b02ff68-b774-49c9-af86-c3f48ae86913 service nova] Creating event network-vif-plugged:9ca59c4a-73d7-4a73-8d8e-3b9185b2a763 for instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc on hv-cinder-85426 Aug 29 22:51:39.758835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-48dad8e9-2c4f-4bf3-9781-34e6b7c19f02 req-8b02ff68-b774-49c9-af86-c3f48ae86913 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071743 Aug 29 22:51:39.760199 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 218/434] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:40.062650 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:40.063256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:40.069400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=61 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:40.088365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.088899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.089358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.090070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.090527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.091013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.246842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:40.262212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:40.281011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.281754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.282047 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.282998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.287217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.288391 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.357289 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:40.371828 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:40.376557 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:40.380095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9f463ebb-724e-4a32-a5c4-fe40ffe37a87 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.320261 Aug 29 22:51:40.405741 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 217/435] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:40 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:40.557506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:40.566301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-718a2d60-cc5d-486c-9b17-8d0d31b96dc0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.334628 Aug 29 22:51:40.566885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 219/436] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:40 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:40.731706 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:40.733859 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:40.750094 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.750705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.751208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.752009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:40.752660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:40.753480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:40.995793 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:41.007440 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cc10587d-9bdb-4d7b-ab3f-67baab995cc5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.279605 Aug 29 22:51:41.010513 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 218/437] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:40 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:41.404220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:41.405575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:41.412664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.416792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.416792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.416792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.416792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.417318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.592436 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:41.597761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:41.606836 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:41.606999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.607366 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.607960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.609084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:41.609695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:41.610262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:41.617652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:41.619611 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:41.621006 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-858632cb-f81e-4a49-853e-ffe3d9675829 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.220941 Aug 29 22:51:41.621774 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 220/438] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:41 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:41.804290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:41.817024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-389488b2-caeb-4ada-a60c-b3043aab3bac tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1314 microversion: 2.1 time: 0.228758 Aug 29 22:51:41.821089 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 219/439] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:41 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:42.043355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:42.049520 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:42.066639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.069496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.070000 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.070866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.072037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.072745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.249642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:42.258843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-160a2530-4583-48c4-a471-c3dbfe9ee435 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.228711 Aug 29 22:51:42.259769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 221/440] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:42 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:42.644427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:42.645109 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:42.651856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.652436 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.652954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.653655 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.654110 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.654539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.791840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:42.801883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:42.804297 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:42.805477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7ca535be-3ab7-4f32-808d-d0f9e947b5b8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1810 microversion: 2.20 time: 0.165196 Aug 29 22:51:42.806069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 220/441] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:42 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:42.863780 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:42.863780 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:42.863780 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.863780 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.864471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:42.864471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:42.864471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:42.864471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.022060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:43.030333 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c241059b-679f-43a6-8a75-d60338594b0e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1499 microversion: 2.1 time: 0.190908 Aug 29 22:51:43.031019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 222/442] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:42 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1499 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:43.283083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:43.283700 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:43.293901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.294658 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.295282 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.296250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.297137 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.297761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.605214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:43.613618 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8fe6ea09-755b-4346-be2b-8d49264d6bee tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.334507 Aug 29 22:51:43.620935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 221/443] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:43 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:43.830545 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:43.830959 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:43.838929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=60 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:43.841117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.841928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.842528 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:43.843391 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:43.843840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:43.844288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.065519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:44.068879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:44.079660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.081134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.081737 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.082915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.085574 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.086231 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.103420 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:44.119241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:44.123123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:44.126115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-334bb5ba-3568-4571-a861-81bedab2c512 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1797 microversion: 2.20 time: 0.300455 Aug 29 22:51:44.128450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 223/444] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:51:43 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1797 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:51:44.161756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:51:44.200955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:44.544919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-dd7e33bd-a692-4c05-960f-b28e8c3020c7 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "DELETE /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 204 len: 0 microversion: 2.1 time: 0.486931 Aug 29 22:51:44.545508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 222/445] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:51:44 2022] DELETE /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 0 bytes in 489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:51:44.558665 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:44.559263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:44.565868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.566410 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.567116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.568069 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.569093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.569748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.645549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:44.647723 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:44.654817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.655692 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.656615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.657898 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:44.658583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:44.659235 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:44.831223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:44.842268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f2198c13-4163-4b69-abc1-0a84c75aa78e tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1505 microversion: 2.1 time: 0.287268 Aug 29 22:51:44.864859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 224/446] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:44 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1505 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:44.901336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:44.909940 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-305267f3-2aa0-4085-82de-4f54a02eae23 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.269078 Aug 29 22:51:44.910760 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 223/447] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:44 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:45.871451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:45.872067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:45.879350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.879940 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.880447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.881791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.882238 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.882657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.886918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:45.939825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:45.940581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:45.948936 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.949776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.950459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:45.951270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:45.951791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:45.952454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.035052 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:46.045178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-ad1eb52b-ddbb-46f8-bed1-6fed41b4da26 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1505 microversion: 2.1 time: 0.177315 Aug 29 22:51:46.060368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 225/448] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:45 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1505 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:46.461335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:46.470200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4e028ec8-ff46-45e3-9693-a47c960db642 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1676 microversion: 2.1 time: 0.534569 Aug 29 22:51:46.471324 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 224/449] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:45 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1676 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:46.958879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-0f792a95-1e07-4285-829c-28457ceb3946 req-2ae2fe45-0315-4b98-9e46-5c6b4e60225c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdff680e-99f7-4dfd-b6b2-fdd495d977dc", "name": "network-vif-deleted", "tag": "9ca59c4a-73d7-4a73-8d8e-3b9185b2a763"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:46.969826 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0f792a95-1e07-4285-829c-28457ceb3946 req-2ae2fe45-0315-4b98-9e46-5c6b4e60225c service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:46.970551 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0f792a95-1e07-4285-829c-28457ceb3946 req-2ae2fe45-0315-4b98-9e46-5c6b4e60225c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:46.971179 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0f792a95-1e07-4285-829c-28457ceb3946 req-2ae2fe45-0315-4b98-9e46-5c6b4e60225c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:46.986928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-0f792a95-1e07-4285-829c-28457ceb3946 req-2ae2fe45-0315-4b98-9e46-5c6b4e60225c service nova] Creating event network-vif-deleted:9ca59c4a-73d7-4a73-8d8e-3b9185b2a763 for instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc on hv-cinder-85426 Aug 29 22:51:46.995246 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-0f792a95-1e07-4285-829c-28457ceb3946 req-2ae2fe45-0315-4b98-9e46-5c6b4e60225c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040550 Aug 29 22:51:47.000133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 226/450] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:47.069604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:47.071298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:47.082286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.086006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.086006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.086006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.086006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.086313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.196204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:47.220855 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d2521875-6fd9-4cbc-a74b-eca3b4807b17 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1463 microversion: 2.1 time: 0.156621 Aug 29 22:51:47.223419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 225/451] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:47 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:47.493141 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:47.493944 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:47.501027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.501578 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.502046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.504385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.504385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.504385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.691816 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:47.702779 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f6262d67-64d7-4df5-a250-e3f9a2da0504 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1653 microversion: 2.1 time: 0.214436 Aug 29 22:51:47.703621 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 227/452] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:47 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1653 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:47.729634 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c6d45ef2-ca3a-4118-b52f-b964675da76c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:47.737758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6d45ef2-ca3a-4118-b52f-b964675da76c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:47.738422 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6d45ef2-ca3a-4118-b52f-b964675da76c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:47.738990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c6d45ef2-ca3a-4118-b52f-b964675da76c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:47.773576 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c6d45ef2-ca3a-4118-b52f-b964675da76c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Going to try to start instance {{(pid=139066) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 29 22:51:47.846595 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fd0f8480-7843-4da6-922d-4a608947e005 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Action: 'create', calling method: .version_select at 0x7efc5fd178b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1881287952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFOxUlifuvzfKjomYrnGDyJLE8Hk8u2UNQzMkIyKEHGMz9xKavdg84iblysHLTPFbHY0d9rodpBISUK44OsxRFzSjV5hpRmt+MO/T2HghOeSfguipZedXiflW6Y7k3FU0A=="}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:47.869240 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-fd0f8480-7843-4da6-922d-4a608947e005 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Getting quotas for project 6468612f8d4e4172a8bcc16f0ba73e5a. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:51:47.873461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-fd0f8480-7843-4da6-922d-4a608947e005 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Getting quotas for user 8cad1ee24ee84aa18da56d1145eac98a and project 6468612f8d4e4172a8bcc16f0ba73e5a. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:51:48.026272 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fd0f8480-7843-4da6-922d-4a608947e005 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.183483 Aug 29 22:51:48.026968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 228/453] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:51:47 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:48.069423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c6d45ef2-ca3a-4118-b52f-b964675da76c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action" status: 202 len: 0 microversion: 2.1 time: 0.344633 Aug 29 22:51:48.070522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 226/454] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:51:47 2022] POST /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/action => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:51:48.078915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:48.079523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:48.087630 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.088115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.088549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.089269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.089908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.090337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.135194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1949477862", "imageRef": "915d4984-15d0-4830-a71d-00f375eaa1f5", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1881287952", "networks": [{"uuid": "a4e652ea-d1fc-4cab-95b5-5f7d6a399d3d"}]}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:48.209484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] validate_networks() for [('a4e652ea-d1fc-4cab-95b5-5f7d6a399d3d', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:51:48.252140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:48.263037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-57b9af42-84cf-4e64-8275-c433f3f22505 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1662 microversion: 2.1 time: 0.187774 Aug 29 22:51:48.263878 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 229/455] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:48 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1662 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:48.283770 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:48.284396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:48.297926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.298402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.299236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.300162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.300745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.301308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.358307 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.358307 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.358307 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.358307 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lazy-loading 'fault' on Instance uuid bdff680e-99f7-4dfd-b6b2-fdd495d977dc {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:51:48.403624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c3c51d98e274150933a1306f7747f42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f38e29d63fd4d04984af578b1708e4a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:48.417241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-09006c0e-26f8-4acc-bf10-ae74c59a7844 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 200 len: 1304 microversion: 2.1 time: 0.137136 Aug 29 22:51:48.417850 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 230/456] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:48 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:48.831641 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:51:48.832100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:51:48.832880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:51:48.833298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:51:48.833760 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:51:48.842842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.843334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.843770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.844497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:48.845111 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:48.845546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:48.864875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Getting quotas for project 6468612f8d4e4172a8bcc16f0ba73e5a. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:51:48.870157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Getting quotas for user 8cad1ee24ee84aa18da56d1145eac98a and project 6468612f8d4e4172a8bcc16f0ba73e5a. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:51:48.882116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:51:48.884849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='915d4984-15d0-4830-a71d-00f375eaa1f5',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:51:49.044155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0e058d9c-c62c-405e-8da7-332444c7026d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.914392 Aug 29 22:51:49.045186 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 227/457] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:51:49.056354 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-508c0749-e80c-479e-b5b3-41717928ca43 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:49.060209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-508c0749-e80c-479e-b5b3-41717928ca43 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:49.139875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-508c0749-e80c-479e-b5b3-41717928ca43 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:49.153030 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-508c0749-e80c-479e-b5b3-41717928ca43 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1259 microversion: 2.1 time: 0.100879 Aug 29 22:51:49.154248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 231/458] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:49 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1259 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:49.286095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:49.286701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:49.293715 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.294421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.294851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.295551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.295993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.296769 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.435544 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:49.446179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-71f15099-a1e4-4f26-a024-658538a66f98 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1662 microversion: 2.1 time: 0.164660 Aug 29 22:51:49.446748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 228/459] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:49 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1662 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:49.446889 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:49.447584 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] [instance: bdff680e-99f7-4dfd-b6b2-fdd495d977dc] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:49.453742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.454225 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.454659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.455452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:49.455908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:49.456329 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:49.471658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] HTTP exception thrown: Instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc could not be found. Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Request method failure captured: Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc HTTP/1.1 Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUK4OrkB_yXQqzCOcXuoLERbOCijv2lHuZpUFT5xmPlVOxjektL71CAQ3Fk0UwArW8-ss6An6DP8kMY59JpdbyklSp9mwFpVsjVSiJLfs0BY_GHMsSnpEHSWGhVsVI7RS4w7hCkadrIqjbKaN4N9NR4X6egF_Z3UldzuzDGihevyAlY Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 4f38e29d63fd4d04984af578b1708e4a Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-VolumesActionsTest-394148704 Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:51:49.473383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/4f38e29d63fd4d04984af578b1708e4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-VolumesActionsTest-394148704 Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 4f38e29d63fd4d04984af578b1708e4a Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-VolumesActionsTest-394148704 Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-VolumesActionsTest-394148704-project Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 9c3c51d98e274150933a1306f7747f42 Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-VolumesActionsTest-394148704-project Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc could not be found. Aug 29 22:51:49.475043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'bdff680e-99f7-4dfd-b6b2-fdd495d977dc'} Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc could not be found. Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:51:49.475919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc could not be found. Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc could not be found. Aug 29 22:51:49.477518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:51:49.478922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] Returning 404 to user: Instance bdff680e-99f7-4dfd-b6b2-fdd495d977dc could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:51:49.478922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-795e6a09-1555-4ce4-a59e-fecbf17692b0 tempest-VolumesActionsTest-394148704 tempest-VolumesActionsTest-394148704-project] 10.222.0.52 "GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc" status: 404 len: 111 microversion: 2.1 time: 0.032797 Aug 29 22:51:49.478922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 232/460] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:49 2022] GET /compute/v2.1/servers/bdff680e-99f7-4dfd-b6b2-fdd495d977dc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:51:50.175454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-209cefcf-132c-417a-8931-cd9e415363ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:50.176093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-209cefcf-132c-417a-8931-cd9e415363ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:50.244097 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-209cefcf-132c-417a-8931-cd9e415363ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:50.250988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-209cefcf-132c-417a-8931-cd9e415363ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1259 microversion: 2.1 time: 0.080304 Aug 29 22:51:50.251546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 229/461] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:50 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:50.468424 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:50.469088 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:50.475182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.475659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.476085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.476779 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:50.477224 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:50.477637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:50.645218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:50.653906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8480f5e3-9ec6-46a9-b892-cac503018317 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1666 microversion: 2.1 time: 0.189326 Aug 29 22:51:50.654829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 233/462] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:50 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1666 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:51.272118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:51.272755 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:51.279181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.279572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.280030 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.280748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:51.281323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:51.288416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:51.345649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:51.354003 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1e8992f3-0c5d-4512-8b0d-747d598fdf98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1311 microversion: 2.1 time: 0.086487 Aug 29 22:51:51.354560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 230/463] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:51 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:52.374888 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:52.375701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:52.382809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.383286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.383715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.384399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:52.384872 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:52.385288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:52.448639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:52.456544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a6785859-7d5c-4ce3-8103-4a5bda27e2f6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1311 microversion: 2.1 time: 0.085484 Aug 29 22:51:52.457140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 234/464] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:52 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:53.479401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:53.480193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:53.487650 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.498907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.499365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.500138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:53.500876 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:53.501930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:53.565587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:53.573851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d6f24707-0a84-4e7c-9736-e4e99bd89d1a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1311 microversion: 2.1 time: 0.100006 Aug 29 22:51:53.574423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 231/465] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:53 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:54.595432 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:54.596079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:54.603366 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.603872 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.604312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.605059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:54.605516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:54.606788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:54.669975 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:54.677730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-922d4120-359f-4759-ad9f-94f4d1050755 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1329 microversion: 2.1 time: 0.086177 Aug 29 22:51:54.678296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 235/466] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:54 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1329 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:55.433073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-17391342", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "networks": [{"uuid": "7214298d-8b6f-46bb-9406-ec92ab2d115a"}]}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:55.702162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:55.702772 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:55.710320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.711338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.711760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.713527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:55.714186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:55.715033 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:55.877425 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:55.888454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-94fff54d-0e15-40d8-8282-b064e638409c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.189836 Aug 29 22:51:55.901373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 236/467] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:55 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:56.440119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-624b10ad-1eb6-480b-b31e-5de209528c40 req-64129853-d5df-4a64-95a8-4d9f11216c52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd65826-c1ef-45f1-ab4f-b4f011a0e44a", "tag": "2e94820d-fd72-49c0-b34f-a592d817d599"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:56.460005 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-624b10ad-1eb6-480b-b31e-5de209528c40 req-64129853-d5df-4a64-95a8-4d9f11216c52 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.464531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-624b10ad-1eb6-480b-b31e-5de209528c40 req-64129853-d5df-4a64-95a8-4d9f11216c52 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.465210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-624b10ad-1eb6-480b-b31e-5de209528c40 req-64129853-d5df-4a64-95a8-4d9f11216c52 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.490176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-624b10ad-1eb6-480b-b31e-5de209528c40 req-64129853-d5df-4a64-95a8-4d9f11216c52 service nova] Creating event network-changed:2e94820d-fd72-49c0-b34f-a592d817d599 for instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a on hv-cinder-85426 Aug 29 22:51:56.501698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-624b10ad-1eb6-480b-b31e-5de209528c40 req-64129853-d5df-4a64-95a8-4d9f11216c52 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066917 Aug 29 22:51:56.502589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 237/468] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:51:56.912119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:56.913593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:56.919984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.920750 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.921341 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:56.922248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:56.923117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:56.923772 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.121473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:57.149400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d9ce84b5-8f9b-4711-860b-952fcabe397b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.231649 Aug 29 22:51:57.169991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 238/469] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:56 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:51:57.197443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1b93ac17-a378-4a13-a926-f771d85d56b0"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:51:57.201969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:57.214061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.214815 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.215454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:57.216328 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:57.216968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:57.217550 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.285730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-deeef38c-ca62-411d-beae-fadf26595c15 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111395 Aug 29 22:51:58.298753 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 239/470] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:51:57 2022] POST /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments => generated 194 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:51:58.308625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:58.323121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:58.336898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.337515 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.338046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.338896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:58.339444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:58.339925 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:58.644808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:58.660074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-db793ec8-4b3c-4a55-b644-e50f3779d2dd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.357560 Aug 29 22:51:58.674344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 240/471] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:58 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:51:58.855219 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:59.681784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:51:59.682484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:51:59.684624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:51:59.698518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.699596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.700339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.701411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:51:59.702164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:51:59.702743 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:51:59.947883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:51:59.962430 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b89d257b-de6b-41be-8ddb-a71a8fe6f66d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.284747 Aug 29 22:51:59.966184 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 241/472] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:51:59 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:00.248660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=8 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:00.987022 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:00.988349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:01.006513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.006989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.018760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.019890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:01.020562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:01.033370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:01.264950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:01.275638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5bb01d30-3061-4303-ae88-113ba00fe0e7 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.294178 Aug 29 22:52:01.276405 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 242/473] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:00 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:02.312797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:02.313569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:02.322200 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:02.322680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:02.323229 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:02.324125 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:02.324697 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:02.325338 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:02.473212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:02.480956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-32a3a63a-8ca7-4ba7-a806-bacde7c6215b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.172270 Aug 29 22:52:02.481523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 243/474] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:02 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:03.504784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:03.513258 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:03.513991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.514993 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.515719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.516794 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:03.517516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:03.518356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:03.521639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.570393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:03.778451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:03.797023 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9c8aa38d-fe34-41cd-b8ca-4168fe7f082c tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.293609 Aug 29 22:52:03.799032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 244/475] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:03 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:04.828128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:04.828861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:04.850342 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.850954 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.852039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:04.852985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:04.853439 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:04.854091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:05.131699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:05.141682 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-00dbc50e-cc46-4890-b0c8-45fa93fd5e5b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.317250 Aug 29 22:52:05.145361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 245/476] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:04 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:05.445240 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:06.169206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:06.170921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:06.179567 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.180475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.181158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.182092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:06.182752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:06.183381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:06.392211 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:06.404687 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9d935e73-ab1b-46e2-95ba-9978f7552ae2 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.240063 Aug 29 22:52:06.426229 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 246/477] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:06 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:07.322807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] validate_networks() for [('7214298d-8b6f-46bb-9406-ec92ab2d115a', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:52:07.454654 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:07.456811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:07.469039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.476300 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.477102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.478053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.478696 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.479294 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.656759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:07.665862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1613d30d-2532-4677-9e7c-88eee530f6f0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.229410 Aug 29 22:52:07.666497 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 247/478] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:07 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:07.767461 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:52:07.767895 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:52:07.768577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:52:07.769056 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:52:07.769471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:52:07.779732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.780396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.780880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.781825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:07.782456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:07.783043 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:07.802460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Getting quotas for project a8c824e8723341808544a577b85d9b2d. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:52:07.808187 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Getting quotas for user 70cf6f471ff04dab9f8cbc268397928e and project a8c824e8723341808544a577b85d9b2d. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:52:07.820601 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:52:07.823409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:52:08.244130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-189f4541-553e-433c-8e45-39dea142c158 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 12.816650 Aug 29 22:52:08.250902 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 232/479] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:51:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 12824 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:52:08.255635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4bb05215-083b-4f6a-bd75-19c4baca7537 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:08.256231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4bb05215-083b-4f6a-bd75-19c4baca7537 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:08.316378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4bb05215-083b-4f6a-bd75-19c4baca7537 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:08.326705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4bb05215-083b-4f6a-bd75-19c4baca7537 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1217 microversion: 2.1 time: 0.073488 Aug 29 22:52:08.341038 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 248/480] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:08 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1217 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:08.688317 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:08.689655 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:08.701870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.702832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.703632 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.704703 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:08.705614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:08.706287 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:08.881713 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:08.891736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e815a81e-f0e8-4453-9116-2df53594e207 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.208012 Aug 29 22:52:08.892565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 233/481] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:08 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:09.349257 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-63c4afef-4752-4efd-81fe-df846441c6ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:09.349975 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-63c4afef-4752-4efd-81fe-df846441c6ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:09.474686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-63c4afef-4752-4efd-81fe-df846441c6ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:09.474686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-63c4afef-4752-4efd-81fe-df846441c6ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1217 microversion: 2.1 time: 0.086051 Aug 29 22:52:09.474686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 249/482] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:09 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:09.916915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:09.917596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:09.925616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.926384 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.927018 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:09.927880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:09.928496 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:09.928993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.146035 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:10.146035 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ee8adb81-0a66-4348-9366-d93f6f595c55 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.231683 Aug 29 22:52:10.146727 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 234/483] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:09 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:10.495274 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:10.495863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:10.505732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.506141 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.506578 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.507831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.508283 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.508708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.584845 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:10.598151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7ac2786a-686a-4ba3-bbcf-a9b39731db03 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1213 microversion: 2.1 time: 0.106675 Aug 29 22:52:10.598994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 250/484] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:10 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:10.860602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:10.867474 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:10.877924 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.888266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.888836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.891062 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:10.891548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:10.892008 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:10.932164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'flavor' on Instance uuid d3390881-2a07-4dfd-a9e3-d17318cf8441 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:52:11.170746 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.172058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.182169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.182885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.183891 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.185256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.186141 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.186820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.321476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-00483f07-7b00-41f4-9f0d-91cf0058c432 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/action" status: 200 len: 32 microversion: 2.1 time: 0.464898 Aug 29 22:52:11.330567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 235/485] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:52:10 2022] POST /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/action => generated 32 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:52:11.339398 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.340464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.350121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.351672 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.352663 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.353829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.354442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.354967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.408303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:11.436109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-057318fc-22ce-41ff-9f97-15bd63159ab5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.272829 Aug 29 22:52:11.441476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 251/486] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:11.622958 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:11.633985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:11.634601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:11.643693 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f35434bd-c24a-49bc-b280-95853cb31223 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.309620 Aug 29 22:52:11.645260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 236/487] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:11.654839 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.655875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.656477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.657650 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:11.658499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:11.659143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:11.741228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:11.755072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cb44ae4b-e3fb-4113-826f-6f12adfcc601 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1277 microversion: 2.1 time: 0.126275 Aug 29 22:52:11.757094 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 252/488] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:11 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1277 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:12.464612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:12.465518 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:12.472334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.472951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.473540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.474420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.474868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.475773 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.670391 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:12.672344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:12.680359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.689061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.689061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.689061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.689061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.689564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.776490 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:12.793126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e4a32e85-de05-4a11-88fc-743272bf25ba tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.332742 Aug 29 22:52:12.810252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 237/489] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:12 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:12.816883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:12.817733 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:12.838914 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.841359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.842006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.842947 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:12.843551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:12.844139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:12.863245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:12.873776 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-48451571-ee78-4bed-8273-4797010f9334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.208314 Aug 29 22:52:12.875382 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 253/490] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:12 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:12.945988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:12.955965 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a07674ac-f3de-412f-9d4b-d8187d0ed6ef tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1275 microversion: 2.1 time: 0.142805 Aug 29 22:52:12.968782 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 238/491] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:12 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:13.609808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-80f8a6f4-c03b-45be-96f4-1e7ff660bb9b req-9768369b-d0d7-4aa3-9324-81aa2f207673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd65826-c1ef-45f1-ab4f-b4f011a0e44a", "name": "network-vif-plugged", "status": "completed", "tag": "2e94820d-fd72-49c0-b34f-a592d817d599"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:13.621174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-80f8a6f4-c03b-45be-96f4-1e7ff660bb9b req-9768369b-d0d7-4aa3-9324-81aa2f207673 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.621565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-80f8a6f4-c03b-45be-96f4-1e7ff660bb9b req-9768369b-d0d7-4aa3-9324-81aa2f207673 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.621979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-80f8a6f4-c03b-45be-96f4-1e7ff660bb9b req-9768369b-d0d7-4aa3-9324-81aa2f207673 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.633577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-80f8a6f4-c03b-45be-96f4-1e7ff660bb9b req-9768369b-d0d7-4aa3-9324-81aa2f207673 service nova] Creating event network-vif-plugged:2e94820d-fd72-49c0-b34f-a592d817d599 for instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a on hv-cinder-85426 Aug 29 22:52:13.649401 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-80f8a6f4-c03b-45be-96f4-1e7ff660bb9b req-9768369b-d0d7-4aa3-9324-81aa2f207673 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039922 Aug 29 22:52:13.649401 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 254/492] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:13.815827 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:13.816670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:13.824356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.826522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.826522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.826522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.826916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.827186 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.899060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:13.899663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:13.905878 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.906444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.906824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:13.907500 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:13.907950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:13.908377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.048296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:14.057604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-75458da8-e213-4302-ba77-b39d4ca2d44e tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.163334 Aug 29 22:52:14.058176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 255/493] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:13 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:14.068630 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:14.070464 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:14.072381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:14.077129 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.077618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.078051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.078776 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.079230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.079649 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.113403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:14.123889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b59ea272-b3ea-4885-8563-43a5958190a4 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.311512 Aug 29 22:52:14.124679 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 239/494] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:13 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:14.218448 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:14.222270 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f3589583-42db-4163-9c98-798a7658aded tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.163001 Aug 29 22:52:14.222829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 256/495] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:14 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:14.349696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-2c46b42a-c734-4a79-b625-4022f7dbb6c6 req-7d35cc4d-8bbb-468b-90d1-3abe1a85498f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22918c24-f85a-42ff-b152-35e097b65135", "tag": "10c49fb7-bcd7-4f90-887a-94870952f162"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:14.359809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-2c46b42a-c734-4a79-b625-4022f7dbb6c6 req-7d35cc4d-8bbb-468b-90d1-3abe1a85498f service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:14.360287 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-2c46b42a-c734-4a79-b625-4022f7dbb6c6 req-7d35cc4d-8bbb-468b-90d1-3abe1a85498f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:14.360712 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-2c46b42a-c734-4a79-b625-4022f7dbb6c6 req-7d35cc4d-8bbb-468b-90d1-3abe1a85498f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:14.373592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-2c46b42a-c734-4a79-b625-4022f7dbb6c6 req-7d35cc4d-8bbb-468b-90d1-3abe1a85498f service nova] Creating event network-changed:10c49fb7-bcd7-4f90-887a-94870952f162 for instance 22918c24-f85a-42ff-b152-35e097b65135 on hv-cinder-85426 Aug 29 22:52:14.378714 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-2c46b42a-c734-4a79-b625-4022f7dbb6c6 req-7d35cc4d-8bbb-468b-90d1-3abe1a85498f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032731 Aug 29 22:52:14.379502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 240/496] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:15.079688 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:15.080373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.088830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.089421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.089926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.090821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.091366 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.091884 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.147119 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:15.148747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.157285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.157776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.158211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.158919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.159374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.159791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.238636 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:15.248086 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-77611d7f-2f2f-4701-9217-6094b08557aa tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.172441 Aug 29 22:52:15.248979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 257/497] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:15 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:15.254316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:15.255140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:15.263521 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.264164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.264693 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.266478 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:15.267124 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:15.267657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:15.336926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:15.345484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-75186ab0-4627-4eda-8af7-71069c10e8bb tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1359 microversion: 2.1 time: 0.202835 Aug 29 22:52:15.346233 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 241/498] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:15 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:15.408161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:15.417162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2fc432f9-f554-4a15-ad92-3b27afed8a3e tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.166629 Aug 29 22:52:15.417758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 258/499] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:15 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:16.271957 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.272624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.279116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.279587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.280013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.280691 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.281159 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.281605 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.373477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.373477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.375120 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.375608 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.376039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.376755 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.377314 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.377685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.416382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:16.425770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-acb711b8-7a11-4903-a943-b034392d61b1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.157550 Aug 29 22:52:16.426392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 242/500] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:16.439292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.439912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.446440 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.446920 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.447358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.448055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.448517 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.448996 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.511585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:16.519306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9a906a78-4336-4fb6-89e9-5e6292ae6da6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1549 microversion: 2.1 time: 0.155846 Aug 29 22:52:16.519869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 259/501] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:16.541840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.542513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.549849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.550455 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.550969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.552048 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.552532 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.552982 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.591348 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:16.599412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d1460b85-1ccd-416b-a1ea-5785b76bc9d8 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.164819 Aug 29 22:52:16.599999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 243/502] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:16.697317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:16.705189 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-65fa807f-0578-484e-90b4-e6d1b3b7f1fa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1549 microversion: 2.1 time: 0.168121 Aug 29 22:52:16.705764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 260/503] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1549 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:16.725733 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.730658 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:16.731416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Searching by: {'deleted': False, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a'} {{(pid=139066) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 29 22:52:16.738649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.739128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.739555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.740264 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.740709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.741161 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.831425 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.multi_cell_list [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=139066) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 29 22:52:16.926350 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-dc9b177c-a9dc-41ce-b57b-3abec698dc91 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.204406 Aug 29 22:52:16.926937 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 244/504] 10.222.0.52 () {58 vars in 1125 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:16.938793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:16.939412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:16.946094 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.946515 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.946950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:16.947634 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:16.948149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:16.948574 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.078740 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:17.086813 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bf5792ec-9623-4b5d-82ce-4bdc955bfb22 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1549 microversion: 2.1 time: 0.151896 Aug 29 22:52:17.087368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 261/505] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:16 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1549 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:17.448102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:17.448774 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:17.455513 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.456003 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.456445 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.457175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.457632 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.458060 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.612685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:17.621413 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:17.622145 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:17.622263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6981c3be-f3e0-4c38-ac71-acf017899263 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.178303 Aug 29 22:52:17.622728 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 245/506] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:17 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:17.628625 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.629264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.629787 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.630575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:17.631117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:17.631632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:17.862885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:17.874035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f9d65425-ee25-427f-9f68-237a1cae1b60 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.256604 Aug 29 22:52:17.875014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 262/507] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:17 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:18.643786 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:18.644328 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:18.646289 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=6 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:18.653012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.653853 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.654456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.655298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.655865 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.656444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.903112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:18.904016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:18.918999 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.919490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.919925 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.920633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:18.921128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:18.921549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:18.937990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:19.030763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:19.040985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3f26fcb7-61b9-43a0-bbea-1883e6780b72 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.401045 Aug 29 22:52:19.041845 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 246/508] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:18 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:19.083912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:19.092632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9ef2798f-f313-4cbc-bf16-81e3f1bdbcbf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.199064 Aug 29 22:52:19.093736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 263/509] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:18 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:19.130543 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cfcf434b-3982-4265-854d-2db93835107d"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:19.132907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:19.139520 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.140176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.140601 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.141304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:19.141746 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:19.142158 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:19.160677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:20.062351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:20.062962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:20.064956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=4 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:20.071083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.071083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.071767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.072465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.072939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.073363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.117615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-237ca106-7e66-4116-a0aa-0c2332362838 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.991210 Aug 29 22:52:20.118404 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 247/510] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:52:19 2022] POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments => generated 194 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:20.124253 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:20.125020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:20.136488 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.136488 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.136488 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.136488 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:20.136880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:20.138251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:20.235191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:20.247145 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a75de742-120a-4673-ab2e-965b5b5fbdef tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.184952 Aug 29 22:52:20.247145 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 264/511] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:20 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:20.303370 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:20.313539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b669aeef-6911-4c21-879f-a2f4f26c9a2a tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.192924 Aug 29 22:52:20.314018 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 248/512] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:20 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:21.269933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:21.270521 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:21.278162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.278644 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.279070 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.279774 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.280209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.280624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.337940 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:21.338540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:21.345553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.346074 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.346686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.348757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.348757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.348757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.418329 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:21.426924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-421acd79-3d2e-4be6-bf42-d6236f8d52cc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.161036 Aug 29 22:52:21.427490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 265/513] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:21 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:21.486086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:21.494739 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2def183d-3405-4d99-8456-372409b5c768 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.161761 Aug 29 22:52:21.495346 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 249/514] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:21 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:21.532817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-36d9db86-f47e-42a3-b2b1-d6b76870c17f req-f5f42941-125c-46b3-8315-0eeafcb7cfa2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22918c24-f85a-42ff-b152-35e097b65135", "name": "network-vif-plugged", "status": "completed", "tag": "10c49fb7-bcd7-4f90-887a-94870952f162"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:21.545715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-36d9db86-f47e-42a3-b2b1-d6b76870c17f req-f5f42941-125c-46b3-8315-0eeafcb7cfa2 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:21.549472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-36d9db86-f47e-42a3-b2b1-d6b76870c17f req-f5f42941-125c-46b3-8315-0eeafcb7cfa2 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:21.549472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-36d9db86-f47e-42a3-b2b1-d6b76870c17f req-f5f42941-125c-46b3-8315-0eeafcb7cfa2 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:21.560691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-36d9db86-f47e-42a3-b2b1-d6b76870c17f req-f5f42941-125c-46b3-8315-0eeafcb7cfa2 service nova] Creating event network-vif-plugged:10c49fb7-bcd7-4f90-887a-94870952f162 for instance 22918c24-f85a-42ff-b152-35e097b65135 on hv-cinder-85426 Aug 29 22:52:21.565606 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-36d9db86-f47e-42a3-b2b1-d6b76870c17f req-f5f42941-125c-46b3-8315-0eeafcb7cfa2 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038345 Aug 29 22:52:21.566187 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 266/515] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:22.450460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:22.451212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:22.457750 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.458239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.458935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.459631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.460134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.460863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.520372 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:22.521414 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:22.530310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.530828 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.531265 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.531962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:22.532419 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:22.532858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:22.603373 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:22.611964 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2727ae35-4219-487a-95e7-82342f9876bc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.165437 Aug 29 22:52:22.612525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 250/516] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:22 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:22.677734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:22.686378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-005050c4-f573-42f8-a04b-bf578b75c2ff tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.170770 Aug 29 22:52:22.686979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 267/517] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:22 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:23.635017 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:23.635601 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:23.642132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.642606 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.643033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.643711 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.644175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.644579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.707039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:23.707645 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:23.716359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.716917 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.717352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.718052 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:23.718509 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:23.718936 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:23.782079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:23.792065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-05711373-9bcb-44c2-9d1a-dad80983d287 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.161391 Aug 29 22:52:23.792596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 251/518] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:23 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:23.857854 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:23.865685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-735493fb-ba37-4be0-99b1-7a16071cd6aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1317 microversion: 2.1 time: 0.162760 Aug 29 22:52:23.866362 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 268/519] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:23 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:24.815393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:24.815999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:24.823435 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.823911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.824337 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.825218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.825672 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.826130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.888474 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:24.889853 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:24.896846 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.897435 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.899352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.899995 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:24.900452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:24.900912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:24.962212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:24.970491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-dd364777-ab28-41e4-afb5-0ff7e7431e96 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.158988 Aug 29 22:52:24.971063 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 252/520] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:24 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:25.036599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:25.045176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a08845af-a09a-468c-88b2-be5b6659a6d2 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1506 microversion: 2.1 time: 0.160970 Aug 29 22:52:25.045749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 269/521] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:24 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:25.993400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:25.994318 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.000983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.001464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.001894 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.002583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.003038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.003455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.141924 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:26.151994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-098bc4f1-4ab4-49b0-a1ba-fa52984bcaeb tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.163278 Aug 29 22:52:26.152797 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 253/522] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:25 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:26.492262 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.493007 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.499583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.500068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.500506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.501495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.502082 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.502826 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.553412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-08079b8e-49cd-4e9a-b5ed-dd414f706c58 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments/b34a759a-f2d7-4ccd-9d13-01c5d9c85545" status: 200 len: 194 microversion: 2.20 time: 0.055173 Aug 29 22:52:26.553412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 270/523] 10.222.0.52 () {60 vars in 1454 bytes} [Mon Aug 29 22:52:26 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments/b34a759a-f2d7-4ccd-9d13-01c5d9c85545 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:52:26.618081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:26.618561 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:26.624573 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.632908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.632908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.632908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:26.632908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:26.634285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:26.759587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lazy-loading 'services' on Instance uuid a1d449df-3756-44b7-b3a5-12ff3702f6bb {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:52:26.811414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=4 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:27.121248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1d88bc20-a15f-43b6-8189-012b91c819d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments/b34a759a-f2d7-4ccd-9d13-01c5d9c85545" status: 202 len: 0 microversion: 2.20 time: 0.507873 Aug 29 22:52:27.121880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 254/524] 10.222.0.52 () {60 vars in 1457 bytes} [Mon Aug 29 22:52:26 2022] DELETE /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments/b34a759a-f2d7-4ccd-9d13-01c5d9c85545 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:52:27.130179 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:27.132961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:27.139262 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.139742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.140173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.141319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.141454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.141851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.172488 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-eeafb06a-72c3-4b7d-841a-e7c184423a48 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046232 Aug 29 22:52:27.173127 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 271/525] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:27 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:27.174249 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:27.174970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:27.182289 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.182774 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.183209 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.183908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:27.184353 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:27.184792 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:27.318640 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:27.328901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b88c00f4-8edb-4af4-9f8c-f647c4c61ad1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.158709 Aug 29 22:52:27.329493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 255/526] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:27 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:28.185621 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:28.187857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:28.194119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.194592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.195017 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.195696 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.196770 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.197191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.226569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a193a6a3-290b-472b-bf70-38c95df8535a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045035 Aug 29 22:52:28.227242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 272/527] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:28 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:52:28.351428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:28.352039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:28.359462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.363767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.363767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.363767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.363767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.364310 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.502730 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:28.507860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c35324d7-da98-4179-900b-7685c031904f tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.160317 Aug 29 22:52:28.508425 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 256/528] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:28 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:28.813097 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:28.813703 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:28.819656 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.820136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.820569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.822061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:28.822623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:28.823034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:28.961035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:28.972176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2d9e11ed-3b1b-4b1a-98bf-89c73ed0dd4e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1595 microversion: 2.1 time: 0.162868 Aug 29 22:52:28.972941 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 273/529] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:28 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:29.240467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.243330 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.250559 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.251477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.252560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.253503 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.253907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.254324 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.285830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-be65d8dd-b4ef-4232-ac6d-5ef4702e20aa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049920 Aug 29 22:52:29.286384 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 257/530] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Aug 29 22:52:29 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:29.349279 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.349805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.356306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.356808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.357232 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.357904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.358343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.358754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.386682 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:52:29.530441 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.530999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.537742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.538482 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.549315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.550093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.551324 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.554316 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.710148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1b04e2e9-f624-4922-948f-310f9784f651 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 204 len: 0 microversion: 2.20 time: 0.364342 Aug 29 22:52:29.711472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 274/531] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Aug 29 22:52:29 2022] DELETE /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:52:29.714899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:29.720712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:29.721879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:29.722316 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e422db66-aa1f-4d01-a111-cedc33e0cccc tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.195731 Aug 29 22:52:29.722936 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 258/532] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:29 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:29.728526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.729129 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.729749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.730609 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:29.731397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:29.731992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:29.955162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:29.964173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:29.965622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:29.966758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7e5d08c9-4a3b-4744-abfe-0cb6703d55c7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.250491 Aug 29 22:52:29.967305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 275/533] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:29 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:30.743987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:30.744751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:30.751446 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.752004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.752505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.753387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:30.753837 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:30.754257 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:30.909911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:30.918776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2d1fea8f-a479-4bb4-bf20-aadfd73727a9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.178646 Aug 29 22:52:30.919353 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 259/534] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:30 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:30.990645 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:30.991269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:31.001483 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.001969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.002482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.003181 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.003639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.004060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.270950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:31.278336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:31.279755 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:31.280936 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-10bf1278-098a-44f1-9f3c-58a20a1b2722 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.294250 Aug 29 22:52:31.281486 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 276/535] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:30 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:52:31.657995 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-9010d636-b3a5-455c-8cbc-bb944a8fd758 req-a94efb2c-a478-40b9-a01a-7e8b7939c81e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd65826-c1ef-45f1-ab4f-b4f011a0e44a", "tag": "2e94820d-fd72-49c0-b34f-a592d817d599"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:31.667679 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-9010d636-b3a5-455c-8cbc-bb944a8fd758 req-a94efb2c-a478-40b9-a01a-7e8b7939c81e service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.668553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-9010d636-b3a5-455c-8cbc-bb944a8fd758 req-a94efb2c-a478-40b9-a01a-7e8b7939c81e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.669114 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-9010d636-b3a5-455c-8cbc-bb944a8fd758 req-a94efb2c-a478-40b9-a01a-7e8b7939c81e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.685401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-9010d636-b3a5-455c-8cbc-bb944a8fd758 req-a94efb2c-a478-40b9-a01a-7e8b7939c81e service nova] Creating event network-changed:2e94820d-fd72-49c0-b34f-a592d817d599 for instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a on hv-cinder-85426 Aug 29 22:52:31.690531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-9010d636-b3a5-455c-8cbc-bb944a8fd758 req-a94efb2c-a478-40b9-a01a-7e8b7939c81e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036084 Aug 29 22:52:31.691349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 260/536] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:31.940734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:31.942398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:31.947909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.948435 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.948910 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:31.949603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:31.950045 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:31.950630 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.131508 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:32.142150 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-34653265-aef7-419e-ae66-64d8601bd817 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.205149 Aug 29 22:52:32.146340 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 277/537] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:31 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:32.304676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:32.306049 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:32.312938 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.313430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.313854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.314546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:32.314991 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:32.315407 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:32.662836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:32.672375 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:32.673863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:32.675290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-39ca7fb4-3fd2-43d2-be70-36bf8cc7e4a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1725 microversion: 2.20 time: 0.374838 Aug 29 22:52:32.684436 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 261/538] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:32 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1725 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:33.173139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:33.173734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:33.182187 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.182914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.183425 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.184565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.185381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.186094 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.355178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:33.363661 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e81ed1bd-8c93-4071-8b08-e8e37ac8ed1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.194948 Aug 29 22:52:33.364241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 278/539] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:33 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:33.688196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-e17de85f-adba-4a12-a52b-ea038765cc63 req-ac201579-6ea2-428b-9ee3-2a6007b1a3ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1d449df-3756-44b7-b3a5-12ff3702f6bb", "name": "network-vif-deleted", "tag": "d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:33.700216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:33.701207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:33.712835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.713351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.713680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.715723 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.716293 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.718397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.720451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e17de85f-adba-4a12-a52b-ea038765cc63 req-ac201579-6ea2-428b-9ee3-2a6007b1a3ef service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:33.721411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e17de85f-adba-4a12-a52b-ea038765cc63 req-ac201579-6ea2-428b-9ee3-2a6007b1a3ef service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:33.723141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e17de85f-adba-4a12-a52b-ea038765cc63 req-ac201579-6ea2-428b-9ee3-2a6007b1a3ef service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:33.747444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-e17de85f-adba-4a12-a52b-ea038765cc63 req-ac201579-6ea2-428b-9ee3-2a6007b1a3ef service nova] Creating event network-vif-deleted:d1ef1706-e2c8-4e1c-8a3d-df71a50e91a7 for instance a1d449df-3756-44b7-b3a5-12ff3702f6bb on hv-cinder-85426 Aug 29 22:52:33.749867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:33.752967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-e17de85f-adba-4a12-a52b-ea038765cc63 req-ac201579-6ea2-428b-9ee3-2a6007b1a3ef service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069652 Aug 29 22:52:33.753809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 262/540] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:33.804313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:33.817872 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:33.820621 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:33.823655 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c74f6071-4aeb-4706-b611-bdbcc8de3b1e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1657 microversion: 2.20 time: 0.128581 Aug 29 22:52:33.824694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 279/541] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:33 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1657 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:52:34.388005 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:34.390220 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:34.396871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.397524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.398074 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.399245 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.399901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.400674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.421578 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:34.619065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:34.652935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e677e6d2-dab3-4b45-bd48-6659887a0228 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.269559 Aug 29 22:52:34.654164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 263/542] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:34 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:34.851568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:34.852410 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:34.862032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.865503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.865503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.865503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.865503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.865887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.904710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:34.904710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:34.906742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:34.906742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lazy-loading 'fault' on Instance uuid a1d449df-3756-44b7-b3a5-12ff3702f6bb {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:52:34.986433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:34.996440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:34.998191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:34.999479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c94a066d-68f4-42d6-8d96-891088edc5cd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 200 len: 1372 microversion: 2.20 time: 0.152414 Aug 29 22:52:35.009200 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 280/543] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:34 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:35.412066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-996011577"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:35.412669 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:35.420461 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.420986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.421578 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.422312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.422770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.423205 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.558648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.network.security_group_api [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Adding security group e868a67a-9153-4e52-be11-2ed8b34d6e23 to port 2e94820d-fd72-49c0-b34f-a592d817d599 Aug 29 22:52:35.687580 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:35.688425 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:35.694680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.695161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.695588 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.696866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:35.697318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:35.697734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:35.874237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:35.885726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-14555deb-c105-4665-a76a-a227b2d3cbf1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.201998 Aug 29 22:52:35.887642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 281/544] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:35 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:36.029983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.030195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:36.036383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.036964 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.037474 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.038368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.039715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.040671 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.056460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] HTTP exception thrown: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Request method failure captured: Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb HTTP/1.1 Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI_Zd7yMP15v8NOGCIyveGFYgl6ICLvlH_3W209PNxhHxa8EuQtdVv1EtaTQhCJxKdUMHwMko4OJYzQjNLZM369wQhSgX1t4B3lcap8wd04avpN4otkfmyEwhmtDavCvjhPGoMpwwXLFyBwI3d5m8SBLLM7onSdx8ma9aNYIJVtVBs Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:52:36.058206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 38a89946e1fb4b43aed992078dba0b4f Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:52:36.059732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'a1d449df-3756-44b7-b3a5-12ff3702f6bb'} Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:52:36.079672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:52:36.081291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:36.082462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Returning 404 to user: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:52:36.082462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9ed6f431-ed03-4afc-865e-3756c9353b6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 404 len: 111 microversion: 2.20 time: 0.035721 Aug 29 22:52:36.082462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 282/545] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:36 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:52:36.091165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-98a35a13-90a9-46d6-a6ed-7358e2b7e052 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '.version_select at 0x7efc5fc49dc0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.184187 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-98a35a13-90a9-46d6-a6ed-7358e2b7e052 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632947759" status: 204 len: 0 microversion: 2.20 time: 0.099370 Aug 29 22:52:36.184885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 283/546] 10.222.0.52 () {60 vars in 1262 bytes} [Mon Aug 29 22:52:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1632947759 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:52:36.285946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-62037858-ca1e-48a8-be24-1e49ab883354 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/action" status: 202 len: 0 microversion: 2.1 time: 0.872754 Aug 29 22:52:36.285946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 264/547] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:52:35 2022] POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/action => generated 0 bytes in 875 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:52:36.294127 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.295102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:36.299596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-c3cc98d9-8518-4db6-a9e3-6b3aae48f8ee req-52f164f5-4341-497e-8781-6a8648ace907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd65826-c1ef-45f1-ab4f-b4f011a0e44a", "tag": "2e94820d-fd72-49c0-b34f-a592d817d599"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:36.307924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.314397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.314397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.314727 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:36.314840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.314840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.314840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.315080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c3cc98d9-8518-4db6-a9e3-6b3aae48f8ee req-52f164f5-4341-497e-8781-6a8648ace907 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.315080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c3cc98d9-8518-4db6-a9e3-6b3aae48f8ee req-52f164f5-4341-497e-8781-6a8648ace907 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.315080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c3cc98d9-8518-4db6-a9e3-6b3aae48f8ee req-52f164f5-4341-497e-8781-6a8648ace907 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.327875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-c3cc98d9-8518-4db6-a9e3-6b3aae48f8ee req-52f164f5-4341-497e-8781-6a8648ace907 service nova] Creating event network-changed:2e94820d-fd72-49c0-b34f-a592d817d599 for instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a on hv-cinder-85426 Aug 29 22:52:36.333167 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-c3cc98d9-8518-4db6-a9e3-6b3aae48f8ee req-52f164f5-4341-497e-8781-6a8648ace907 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037333 Aug 29 22:52:36.334642 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 265/548] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:36.536473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:36.547810 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-52c9b141-2bc7-4530-a7fa-4f7e707d2612 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1759 microversion: 2.1 time: 0.259425 Aug 29 22:52:36.548899 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 284/549] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:36 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1759 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:36.914925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:36.915921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:36.941851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.942367 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.942818 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:36.943729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:36.944190 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:36.945158 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:37.123770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:37.132328 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-37b03ae7-455e-4f41-91b1-fbd9c2be3ce1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.224504 Aug 29 22:52:37.132921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 266/550] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:36 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:37.369693 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1c469168-df8c-41b5-8921-ffcfd5ca8d32 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'create', calling method: .version_select at 0x7efc5fc7c160>, body: {"keypair": {"name": "tempest-keypair-460813611", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZFYmhvnGAq8rNzSihU6UojoxYpxUjCGWJealimui6arxZ2iP9O/8e2qpnC5q/uQe5qpBgMvYeqHsyqEXFhs68fHom7eos7ydWAMlqdAwQEfKXguxRgfoVa8gXeNJ9X9g=="}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:37.385775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-1c469168-df8c-41b5-8921-ffcfd5ca8d32 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:52:37.389655 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-1c469168-df8c-41b5-8921-ffcfd5ca8d32 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for user 38a89946e1fb4b43aed992078dba0b4f and project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:52:37.477002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1c469168-df8c-41b5-8921-ffcfd5ca8d32 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.111851 Aug 29 22:52:37.478137 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 285/551] 10.222.0.52 () {62 vars in 1200 bytes} [Mon Aug 29 22:52:37 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 114 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 29 22:52:38.156978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:38.161631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:38.167596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.168423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.169479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.170288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:38.170820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:38.171447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:38.396902 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:38.405065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ff3b38f2-89ac-47f2-b0f3-43225661c989 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.255234 Aug 29 22:52:38.405653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 267/552] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:38 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:39.426692 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:39.427472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:39.435458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.435947 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.436379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.437115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:39.437595 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:39.438015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:39.828994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:39.838596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-baf56989-4fde-4a15-a451-6946c0491d33 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1734 microversion: 2.1 time: 0.415719 Aug 29 22:52:39.839178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 286/553] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:39 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1734 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:40.305289 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2109742148", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b1b1aef3-5468-47e0-acb3-a09710f077e5"}], "security_groups": [{"name": "tempest-securitygroup--855919282"}], "key_name": "tempest-keypair-460813611", "user_data": "}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:40.412083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] validate_networks() for [('b1b1aef3-5468-47e0-acb3-a09710f077e5', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:52:40.802326 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:52:40.802748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:52:40.803251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:52:40.803735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:52:40.804098 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:52:40.814740 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.815229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.815741 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.816476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.816956 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.817375 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.838298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:52:40.842307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Getting quotas for user 38a89946e1fb4b43aed992078dba0b4f and project a0e8b532701e43a39a0fd260e3e5d12d. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:52:40.853653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:52:40.856014 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:52:40.860670 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:40.861379 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:40.868534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.869549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.869993 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:40.870892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:40.871540 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:40.871969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.013549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7b28da53-569a-4394-be26-7225026e0dc2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.713838 Aug 29 22:52:41.014542 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 268/554] 10.222.0.52 () {62 vars in 1188 bytes} [Mon Aug 29 22:52:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 29 22:52:41.021559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:41.025890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ae4aebb3-cb4b-4b48-afde-50d40509fd4e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:41.026505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ae4aebb3-cb4b-4b48-afde-50d40509fd4e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.032324 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-05632383-0ee4-4716-9f7d-47b3104ab83d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1714 microversion: 2.1 time: 0.175096 Aug 29 22:52:41.032934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 287/555] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:40 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:52:41.098862 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ae4aebb3-cb4b-4b48-afde-50d40509fd4e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:41.107319 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ae4aebb3-cb4b-4b48-afde-50d40509fd4e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:41.109038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ae4aebb3-cb4b-4b48-afde-50d40509fd4e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:41.110100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ae4aebb3-cb4b-4b48-afde-50d40509fd4e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1281 microversion: 2.20 time: 0.088899 Aug 29 22:52:41.110843 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 269/556] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:41 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:52:41.150409 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:41.150897 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.157300 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.157719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.158151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.158733 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.159787 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.160229 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.244483 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] HTTP exception thrown: Cannot 'detach_volume' instance d3390881-2a07-4dfd-a9e3-d17318cf8441 while it is in vm_state rescued Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Request method failure captured: Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments/1b93ac17-a378-4a13-a926-f771d85d56b0 HTTP/1.1 Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI_fx_ax7hXaVFnEIBOJPme5Yx-yHAOZEe7ob7RyetMxYxlOOq1u_Vs5fNJRAziZfgejU9-7rcscOUfjEh4uk-HAA3fex7iX8gvxmh5D1Slue9mJZCfARw4zI6mr2xg0Rf8e8bZRPhXgtGx4NduV7AOki27W8KNUFzfDUXD-wgvd10 Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:52:41.245991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 53f9f8eb7a20431ca0d679af45946bce Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:52:41.247498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Cannot 'detach_volume' instance d3390881-2a07-4dfd-a9e3-d17318cf8441 while it is in vm_state rescued Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'server_id': 'd3390881-2a07-4dfd-a9e3-d17318cf8441', 'id': '1b93ac17-a378-4a13-a926-f771d85d56b0'} Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d3390881-2a07-4dfd-a9e3-d17318cf8441 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:52:41.248318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d3390881-2a07-4dfd-a9e3-d17318cf8441 while it is in vm_state rescued Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d3390881-2a07-4dfd-a9e3-d17318cf8441 while it is in vm_state rescued Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:52:41.249963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Returning 409 to user: Cannot 'detach_volume' instance d3390881-2a07-4dfd-a9e3-d17318cf8441 while it is in vm_state rescued {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:52:41.251332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5ae90c1a-02fe-4392-800f-bc37c53927b0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments/1b93ac17-a378-4a13-a926-f771d85d56b0" status: 409 len: 152 microversion: 2.1 time: 0.101844 Aug 29 22:52:41.251332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 288/557] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:52:41 2022] DELETE /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments/1b93ac17-a378-4a13-a926-f771d85d56b0 => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 29 22:52:41.256581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:41.257166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.264035 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.264524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.265019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.265725 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.266183 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.266609 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.472905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-60926a08-a01f-43b4-885d-a038fedd5a4b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "POST /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/action" status: 202 len: 0 microversion: 2.1 time: 0.219956 Aug 29 22:52:41.473603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 270/558] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:52:41 2022] POST /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:52:41.483494 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:41.484109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:41.491337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.492075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.492579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.493980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:41.494457 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:41.494869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:41.663374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:41.672574 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5dadcb5e-fdcb-4bec-aec4-768d78ebe7c0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1722 microversion: 2.1 time: 0.193752 Aug 29 22:52:41.674122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 289/559] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:41 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:42.137518 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:42.138412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:42.145315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.145962 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.146407 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.147142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.147593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.148017 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.215879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:42.223908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:42.225408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:42.226497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-999992ed-f913-4936-b46d-77466770dfe8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1285 microversion: 2.20 time: 0.094777 Aug 29 22:52:42.227036 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 271/560] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:42 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:42.695092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:42.695726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:42.703167 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.703648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.704077 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.704783 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:42.705232 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:42.705652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:42.845028 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:42.853434 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-be69f32a-3d60-4312-9092-3d5ca6c28e16 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1722 microversion: 2.1 time: 0.162190 Aug 29 22:52:42.853985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 290/561] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:42 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:43.249336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:43.249987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:43.256436 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.256951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.257386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.258073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.259136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.259587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.325910 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:43.333929 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:43.335644 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:43.337086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-95e06468-12d5-4e1d-a27c-8dad803b63cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1333 microversion: 2.20 time: 0.091301 Aug 29 22:52:43.337349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 272/562] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:43 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:43.874353 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:43.874998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:43.881832 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.887073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.887073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:43.887073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:43.887073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:43.888031 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.026064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:44.034287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f12fdbed-9efc-4714-87b7-7549f3176c0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1722 microversion: 2.1 time: 0.163721 Aug 29 22:52:44.034855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 291/563] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:43 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:44.358644 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:44.359167 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:44.365686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.366165 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.366598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.367279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:44.367757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:44.368280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:44.428121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:44.436002 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:44.437467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:44.438550 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8fab6b3e-f106-4163-a213-5296356fb88e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1333 microversion: 2.20 time: 0.083943 Aug 29 22:52:44.439099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 273/564] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:44 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1333 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:45.056768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:45.057301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:45.059339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:45.064059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.064540 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.065058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.065756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.066210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.066628 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.198952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:45.207158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4f75e38b-02ab-42c3-84b7-b8b5dd28c2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1728 microversion: 2.1 time: 0.155533 Aug 29 22:52:45.207725 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 292/565] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:45 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:45.229236 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:45.230148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:45.236428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.236956 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.237408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.238100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.238555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.238983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.378840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a59d33a9-392f-44c5-876e-083eb3594b1d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141635 Aug 29 22:52:45.388165 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 274/566] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:52:45 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-interface => generated 284 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:45.469435 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:45.470116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:45.476582 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.477398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.478071 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.479277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:45.479915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:45.480515 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:45.584136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:45.594786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:45.596370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:45.597831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7a0ec2d9-7e11-40f4-9ca9-eeab9e7c22cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1351 microversion: 2.20 time: 0.140451 Aug 29 22:52:45.598463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 293/567] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:45 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:46.476215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-d5f0794e-95c5-481e-a351-3222c401045f req-530db58b-256f-4133-b1fc-c4c11fe6dd4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3390881-2a07-4dfd-a9e3-d17318cf8441", "tag": "d5317cad-0fae-4b42-bce5-918aa12399dd"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:46.530907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-d5f0794e-95c5-481e-a351-3222c401045f req-530db58b-256f-4133-b1fc-c4c11fe6dd4e service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.530907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-d5f0794e-95c5-481e-a351-3222c401045f req-530db58b-256f-4133-b1fc-c4c11fe6dd4e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.530907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-d5f0794e-95c5-481e-a351-3222c401045f req-530db58b-256f-4133-b1fc-c4c11fe6dd4e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.569096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-d5f0794e-95c5-481e-a351-3222c401045f req-530db58b-256f-4133-b1fc-c4c11fe6dd4e service nova] Creating event network-changed:d5317cad-0fae-4b42-bce5-918aa12399dd for instance d3390881-2a07-4dfd-a9e3-d17318cf8441 on hv-cinder-85426 Aug 29 22:52:46.581662 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-d5f0794e-95c5-481e-a351-3222c401045f req-530db58b-256f-4133-b1fc-c4c11fe6dd4e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114350 Aug 29 22:52:46.583474 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 275/568] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:46.623577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:46.624317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:46.635108 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.635846 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.636300 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.637089 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:46.637948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:46.645411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:46.811994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:46.823130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:46.829743 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:46.829743 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-81a3825f-2832-4848-ae26-5fe6a52d2faf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.209324 Aug 29 22:52:46.829743 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 294/569] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:46 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:47.803064 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-80d07bba-4204-46b3-85f7-c26ece184642 req-0f16b440-3ee5-47f3-80bb-909dd54ae22f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4382fa7b-f19c-4e64-bcb4-28994556231c", "tag": "4a7754e6-246d-4310-9f9e-5d280d55294e"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:47.814237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-80d07bba-4204-46b3-85f7-c26ece184642 req-0f16b440-3ee5-47f3-80bb-909dd54ae22f service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.814712 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-80d07bba-4204-46b3-85f7-c26ece184642 req-0f16b440-3ee5-47f3-80bb-909dd54ae22f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.815142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-80d07bba-4204-46b3-85f7-c26ece184642 req-0f16b440-3ee5-47f3-80bb-909dd54ae22f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.827099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-80d07bba-4204-46b3-85f7-c26ece184642 req-0f16b440-3ee5-47f3-80bb-909dd54ae22f service nova] Creating event network-changed:4a7754e6-246d-4310-9f9e-5d280d55294e for instance 4382fa7b-f19c-4e64-bcb4-28994556231c on hv-cinder-85426 Aug 29 22:52:47.831761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-80d07bba-4204-46b3-85f7-c26ece184642 req-0f16b440-3ee5-47f3-80bb-909dd54ae22f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032820 Aug 29 22:52:47.832351 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 276/570] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:47.850452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:47.851148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:47.853570 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=4 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:47.858727 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.859280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.859635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.860321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:47.860796 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:47.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:47.994093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:48.002092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:48.003533 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:48.004620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-351138ca-98f7-423e-84de-b5bb57308218 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.158785 Aug 29 22:52:48.005206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 295/571] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:47 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:48.135469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a12b4ec3-b170-4499-b21f-be37e49ca0ea", "device": "/dev/sdb"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:48.138441 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:48.144580 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.145107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.145530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.146220 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.146674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.147093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.610929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-27f1ca62-c351-4eab-8953-20356b7b2180 req-6254436c-e211-4b9a-9cc7-2944a53ae092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3390881-2a07-4dfd-a9e3-d17318cf8441", "tag": "d5317cad-0fae-4b42-bce5-918aa12399dd"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:48.621125 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-27f1ca62-c351-4eab-8953-20356b7b2180 req-6254436c-e211-4b9a-9cc7-2944a53ae092 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:48.621635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-27f1ca62-c351-4eab-8953-20356b7b2180 req-6254436c-e211-4b9a-9cc7-2944a53ae092 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:48.622060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-27f1ca62-c351-4eab-8953-20356b7b2180 req-6254436c-e211-4b9a-9cc7-2944a53ae092 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:48.632746 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-27f1ca62-c351-4eab-8953-20356b7b2180 req-6254436c-e211-4b9a-9cc7-2944a53ae092 service nova] Creating event network-changed:d5317cad-0fae-4b42-bce5-918aa12399dd for instance d3390881-2a07-4dfd-a9e3-d17318cf8441 on hv-cinder-85426 Aug 29 22:52:48.637916 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-27f1ca62-c351-4eab-8953-20356b7b2180 req-6254436c-e211-4b9a-9cc7-2944a53ae092 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030631 Aug 29 22:52:48.638527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 296/572] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:52:49.029128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:49.029815 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:49.035998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.036472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.036932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.037604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:49.038046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:49.038460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:49.174394 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:49.183406 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:49.184915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:49.186063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-239c3dd6-68d6-4bdf-b9b6-09dea0407f7b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.162203 Aug 29 22:52:49.186923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 297/573] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:49 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:52:50.209771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:50.210375 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:50.217702 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.218175 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.218664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.219374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:50.219821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:50.220234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:50.381444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:50.384596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:50.392394 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:50.394457 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:50.395698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f05d5263-02ba-4c23-8713-7a423c18e5a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.190338 Aug 29 22:52:50.396259 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 298/574] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:50 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:52:50.829432 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:51.045975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6a8fc379-9d29-4e5f-81d8-8b063abbbb47 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "POST /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.914723 Aug 29 22:52:51.046815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 277/575] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:52:48 2022] POST /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135/os-volume_attachments => generated 194 bytes in 2917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:51.420523 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:51.421141 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:51.427165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.427642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.428058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.428782 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:51.429226 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:51.429637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:51.570083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:51.579491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:51.580951 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:51.582118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-17ddaa25-0954-4f1a-843b-49409e5df2a8 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.166960 Aug 29 22:52:51.582665 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 299/576] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:51 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:52.603816 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=8 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:52.608594 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:52.609420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:52.615600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.616078 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.616533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.617324 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:52.617733 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:52.618190 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:52.760033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:52.770139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:52.771723 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:52.772906 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-66794ab8-9cac-4ccf-95ef-c93e5c993e78 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.170034 Aug 29 22:52:52.773493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 278/577] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:52 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:53.796280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:53.796821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:53.803146 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.803615 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.804043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.804706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.805169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.805577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.934093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:53.936371 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:53.943202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.943688 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.944141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.944844 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:53.945299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:53.945726 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:53.948880 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:53.957334 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:53.958776 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:53.960152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f435b4f4-5d14-4e9f-98df-4ef782309ebc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.167891 Aug 29 22:52:53.960792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 300/578] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:53 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:53.977197 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-97364aa4-d049-4c1f-b56c-1cb3f3642b4d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047925 Aug 29 22:52:53.977757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 279/579] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:52:53 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 29 22:52:54.041490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:54.042166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:54.049490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.050277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.050605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.051328 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.051808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.052227 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.078562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:52:54.414054 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-508f9af9-2c24-4920-a0ea-4455935429d5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 204 len: 0 microversion: 2.1 time: 0.374808 Aug 29 22:52:54.414054 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 301/580] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:52:54 2022] DELETE /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:52:54.422201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:54.422805 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:54.428809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.429335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.429768 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.430455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.430909 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.432058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.567731 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:54.575800 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0cb75c52-0c34-4d46-8f02-fd0f75239501 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1672 microversion: 2.1 time: 0.157361 Aug 29 22:52:54.576388 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 280/581] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:54 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:54.986271 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:54.987018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:54.993575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.994068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.994701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:54.995183 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:54.995665 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:54.996081 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.136585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:55.144889 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:55.146348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:55.147430 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3b44d203-43f8-4a6f-a3d8-325fcb309cbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.165586 Aug 29 22:52:55.147979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 302/582] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:54 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:52:55.599027 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:55.599633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:55.606549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.607024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.607451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.608130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:55.608664 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:55.614226 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:55.741105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:55.751452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-445b050b-0ae2-48bc-9c35-eaa530a00c0c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1672 microversion: 2.1 time: 0.156488 Aug 29 22:52:55.752076 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 281/583] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:55 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:56.171991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:56.172504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:56.178789 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.179260 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.179684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.180359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.180827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.181240 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.314957 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:56.322890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:56.324301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:56.325416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-129a8235-b6ff-4744-b933-d114436b8f14 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.157357 Aug 29 22:52:56.325967 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 303/584] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:56 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:56.773467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:56.774066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:56.783378 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.784492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.784961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.785818 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:56.786256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:56.786669 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:56.790972 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:52:57.001699 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:57.010708 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ded29f49-3e32-4c94-b769-23941241ace4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1672 microversion: 2.1 time: 0.241014 Aug 29 22:52:57.025150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 282/585] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:56 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1672 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:57.355435 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:57.357071 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:57.367038 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.367527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.367956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.368651 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.370012 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.371134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.592370 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:57.605732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:57.608888 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:57.608888 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3a80780e-5d39-4aea-8ee1-16202f11e042 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.261401 Aug 29 22:52:57.624541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 304/586] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:57 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:57.679915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-840c80f0-facf-497a-b4d0-773f86b5327a req-bfd3687f-35d1-4bc1-b381-2ae2fba6da4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4382fa7b-f19c-4e64-bcb4-28994556231c", "name": "network-vif-plugged", "status": "completed", "tag": "4a7754e6-246d-4310-9f9e-5d280d55294e"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:57.692392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-1c7c9849-6f3e-4033-9d9a-844187c57204 req-b8f5a040-d4c0-4b69-8ea7-9b06c5e7a0d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90821429-6373-4dcf-ac68-2af347d45eb1", "name": "network-vif-deleted", "tag": "c4b5d8f5-060a-47e7-bc2d-0768effb9dcb"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:52:57.705469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-840c80f0-facf-497a-b4d0-773f86b5327a req-bfd3687f-35d1-4bc1-b381-2ae2fba6da4b service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.706504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-840c80f0-facf-497a-b4d0-773f86b5327a req-bfd3687f-35d1-4bc1-b381-2ae2fba6da4b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.707396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-840c80f0-facf-497a-b4d0-773f86b5327a req-bfd3687f-35d1-4bc1-b381-2ae2fba6da4b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.719622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1c7c9849-6f3e-4033-9d9a-844187c57204 req-b8f5a040-d4c0-4b69-8ea7-9b06c5e7a0d6 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:57.720112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1c7c9849-6f3e-4033-9d9a-844187c57204 req-b8f5a040-d4c0-4b69-8ea7-9b06c5e7a0d6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:57.720544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1c7c9849-6f3e-4033-9d9a-844187c57204 req-b8f5a040-d4c0-4b69-8ea7-9b06c5e7a0d6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:57.732818 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-840c80f0-facf-497a-b4d0-773f86b5327a req-bfd3687f-35d1-4bc1-b381-2ae2fba6da4b service nova] Creating event network-vif-plugged:4a7754e6-246d-4310-9f9e-5d280d55294e for instance 4382fa7b-f19c-4e64-bcb4-28994556231c on hv-cinder-85426 Aug 29 22:52:57.746812 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-840c80f0-facf-497a-b4d0-773f86b5327a req-bfd3687f-35d1-4bc1-b381-2ae2fba6da4b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071729 Aug 29 22:52:57.747774 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 283/587] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:57.750197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-1c7c9849-6f3e-4033-9d9a-844187c57204 req-b8f5a040-d4c0-4b69-8ea7-9b06c5e7a0d6 service nova] Creating event network-vif-deleted:c4b5d8f5-060a-47e7-bc2d-0768effb9dcb for instance 90821429-6373-4dcf-ac68-2af347d45eb1 on hv-cinder-85426 Aug 29 22:52:57.756100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-1c7c9849-6f3e-4033-9d9a-844187c57204 req-b8f5a040-d4c0-4b69-8ea7-9b06c5e7a0d6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067476 Aug 29 22:52:57.756962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 305/588] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:52:58.034059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:58.034758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:58.042671 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.043164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.043604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.044323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.044987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.045421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.115163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:58.123953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-11f8142f-6903-4995-834b-585a7b3080ea tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1605 microversion: 2.1 time: 0.094431 Aug 29 22:52:58.124783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 284/589] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:58 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1605 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:58.633560 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:58.634336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:58.642090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.642971 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.643553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.644399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:58.645019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:58.645620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:58.802681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:58.813604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:58.815244 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:58.816595 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f2395733-26e4-4098-af29-6b7206d579e6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.188323 Aug 29 22:52:58.817837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 306/590] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:58 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:52:59.146226 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:59.146756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:59.153704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.154280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.154710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.155480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.155926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.156402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.238718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:52:59.249599 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2a10c6f7-0894-40bd-9b25-cf82082c4ce1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1605 microversion: 2.1 time: 0.107361 Aug 29 22:52:59.250281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 285/591] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:52:59 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1605 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:52:59.842078 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:52:59.843459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:52:59.852534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.852534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.852534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:52:59.852534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:52:59.854519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:52:59.854878 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.000543 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:00.008596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:00.010174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:00.016631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f05909de-8bdf-46a2-9279-d1380da2b52b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.174169 Aug 29 22:53:00.016631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 307/592] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:52:59 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:53:00.273653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:00.274204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:00.281233 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.281688 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.282125 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.282815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:00.283268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:00.283691 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:00.349112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:00.357599 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a28bbd78-a6d9-4be2-99b5-f9c4c2d24588 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1605 microversion: 2.1 time: 0.087852 Aug 29 22:53:00.358462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 286/593] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:00 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:00.811495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1838969034", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:00.862873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] validate_networks() for None {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:53:01.033779 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:01.034391 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.040740 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.042061 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.042507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.043218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.043675 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.044101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.144213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:53:01.144663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:53:01.145184 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:53:01.145592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:53:01.146009 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:53:01.155153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.155632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.156060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.156800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.157285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.157705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.174358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Getting quotas for project 3dacdd3e7b3240aabacdf5c385d5b9b2. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:53:01.176597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:01.178303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Getting quotas for user 785d6ff244c841df97f5b3cbfc56d8d9 and project 3dacdd3e7b3240aabacdf5c385d5b9b2. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:53:01.188532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:01.190423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:01.192505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-957618d5-e498-4dae-82be-d26c07a8cfbf tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.162306 Aug 29 22:53:01.193775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 287/594] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:53:01 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:53:01.200432 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:53:01.202835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:53:01.339057 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f3b520cb-e0ad-4b66-a065-b437cc32e6b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530292 Aug 29 22:53:01.339057 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 308/595] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:53:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:53:01.353042 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d4c086c9-92f6-4f63-a9c2-39b3d33cab78 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:01.354320 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d4c086c9-92f6-4f63-a9c2-39b3d33cab78 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.378921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:01.379530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:01.386836 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.387319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.387744 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.388648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:01.389121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:01.389719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:01.414273 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d4c086c9-92f6-4f63-a9c2-39b3d33cab78 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:01.422461 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d4c086c9-92f6-4f63-a9c2-39b3d33cab78 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1215 microversion: 2.1 time: 0.075350 Aug 29 22:53:01.423339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 288/596] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:01 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:01.462335 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:01.470343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fba7ce5c-385a-43c5-8347-bc58b66216a1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1605 microversion: 2.1 time: 0.095300 Aug 29 22:53:01.470961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 309/597] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:01 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:02.217172 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:02.217776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:02.223777 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.224250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.224679 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.225409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.225835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.226251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.360186 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:02.368771 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:02.370958 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:02.372063 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5384ed80-5327-4025-8306-9501510a7a5e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.159115 Aug 29 22:53:02.372629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 289/598] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:53:02 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:53:02.445557 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bcd246d6-6101-47f6-ae06-1b05c51b9c79 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:02.446159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bcd246d6-6101-47f6-ae06-1b05c51b9c79 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:02.492670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:02.493303 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:02.501395 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bcd246d6-6101-47f6-ae06-1b05c51b9c79 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:02.501553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.501553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.501553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.501553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:02.502001 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:02.502428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:02.506004 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bcd246d6-6101-47f6-ae06-1b05c51b9c79 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1215 microversion: 2.1 time: 0.064419 Aug 29 22:53:02.506563 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 310/599] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:02 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:02.576347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:02.584152 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-96c9a91c-a77f-4495-87e1-f6ff05ab182d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1605 microversion: 2.1 time: 0.095322 Aug 29 22:53:02.584986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 290/600] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:02 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:03.394503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:03.395095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:03.401827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.402302 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.402724 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.403395 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.403834 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.404243 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.527546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:03.532433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:03.537475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:03.549775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.550299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.550743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.551122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:03.551464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.551923 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.552363 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.553072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:03.557839 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e18fe079-ed3c-4dd9-8329-0b825a2e9664 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.164054 Aug 29 22:53:03.557839 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 311/601] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:53:03 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:53:03.607891 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:03.608662 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:03.614768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.615251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.615684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.616904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.616904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.617240 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.641795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:03.651866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:03.652242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:03.652683 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:03.652851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-86ae3f7d-a4ad-4f78-8221-89ee2e7a4adb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1211 microversion: 2.1 time: 0.130111 Aug 29 22:53:03.653162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lazy-loading 'fault' on Instance uuid 90821429-6373-4dcf-ac68-2af347d45eb1 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:03.656989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 291/602] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:03 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1211 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:03.708036 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:03.716480 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2c6fba43-1b73-4be9-a0ed-47c72ff6dbde tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1326 microversion: 2.1 time: 0.113366 Aug 29 22:53:03.717078 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 312/603] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:03 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1326 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:04.578720 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.579331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.586129 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.586622 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.587100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.587788 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.588242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.588666 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.675224 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.675829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.682353 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.682830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.683260 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.683977 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.684429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.684874 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.726612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:04.734987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:04.736430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:04.737637 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ef02a870-2539-4b89-b8b6-3b0319f57a55 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1406 microversion: 2.20 time: 0.163367 Aug 29 22:53:04.738434 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 292/604] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:53:04.743303 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:04.744066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:04.750568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.750705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:04.751058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.751498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.752194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.752649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.753100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.758640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bfa8a2f4-011c-4616-8471-bfe8537fc731 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1267 microversion: 2.1 time: 0.087103 Aug 29 22:53:04.759144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 313/605] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:04.786969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:04.787451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:04.787887 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:04.788331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lazy-loading 'fault' on Instance uuid 90821429-6373-4dcf-ac68-2af347d45eb1 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:04.829789 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:04.837905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-79caf093-d66e-4682-b604-133bb0392747 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 200 len: 1326 microversion: 2.1 time: 0.098090 Aug 29 22:53:04.838702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 293/606] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:04 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:05.760219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.761154 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.770074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.774320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.774320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.774320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.774320 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.774754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.782503 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.783144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.789693 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.790182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.790617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.791311 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.791762 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.792208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.862624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:05.872228 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1741e043-2da9-443b-99c0-3acb49abacd8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1267 microversion: 2.1 time: 0.092944 Aug 29 22:53:05.872228 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 294/607] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1267 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:05.876104 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.876807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.884900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.885459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.885989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.886744 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.887319 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.887945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.901649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] HTTP exception thrown: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Request method failure captured: Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 HTTP/1.1 Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI6tfZt48w8aPz6LpFCI5m2fgH0G36x1__zvbrujspsgoyYEoWTML0nA9sNfqHF0dykequfwzsrmwmzHlhfmTLJAemlsx3P1C8BE-M3u10kyeAzTGwmEkfNjV_9aDmTHGpq_Qp8OEhCAKI3UbxQ39D7juV8XcAedDnjjropNSmRVNQ Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:53:05.904081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: bcd83a222eb04368a409db06389f1b7d Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:53:05.905556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '90821429-6373-4dcf-ac68-2af347d45eb1'} Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:53:05.906531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:53:05.908050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:05.910212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Returning 404 to user: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:53:05.910212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-bba46e14-9986-486a-ba08-972954e5cbeb tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 404 len: 111 microversion: 2.1 time: 0.033137 Aug 29 22:53:05.910212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 295/608] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:05.919692 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-045ac2dc-0de4-4d91-8eb1-8f1dfc918247 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '.version_select at 0x7efc5fad6ee0>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.931544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:05.942195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:05.943744 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:05.945181 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-790125cf-63dc-4cbb-a0db-7bb7f56e0dd4 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1599 microversion: 2.20 time: 0.188907 Aug 29 22:53:05.945744 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 314/609] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1599 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:53:05.970924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:05.971415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:05.977357 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.977835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.978269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:05.978956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:05.979408 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:05.979825 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.012482 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-045ac2dc-0de4-4d91-8eb1-8f1dfc918247 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-856013112" status: 202 len: 0 microversion: 2.1 time: 0.098277 Aug 29 22:53:06.013115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 296/610] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Aug 29 22:53:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-856013112 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:53:06.061037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-de954307-0f79-48e0-b7d4-1cccbebe870e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.093806 Aug 29 22:53:06.061629 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 315/611] 10.222.0.52 () {60 vars in 1316 bytes} [Mon Aug 29 22:53:05 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 29 22:53:06.877315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fe005302-ec2d-49f5-bd5e-30ec685a67e8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'create', calling method: .version_select at 0x7efc5fb82f70>, body: {"keypair": {"name": "tempest-keypair-570855089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN2aNYTDN9T5xnFnYNz5ot2DKhSE1RAhEOdegXu6mBHOsLEf3Hp6HHlsueaD2YUd0e9ws17ft2guib9AKtHj3CqT2NzKQLs5ncfBmiGkbrVZrgdOiTVemSGa/pFJYQFong=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:06.892618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:06.896989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:06.897132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-fe005302-ec2d-49f5-bd5e-30ec685a67e8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:53:06.899568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.900043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.900463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.900581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-fe005302-ec2d-49f5-bd5e-30ec685a67e8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for user bcd83a222eb04368a409db06389f1b7d and project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:53:06.901170 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:06.901648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:06.902182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:06.907701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:06.973867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:06.981743 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-dd114c7c-e1f5-4587-b3a6-63fcfbce3e86 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1275 microversion: 2.1 time: 0.093510 Aug 29 22:53:06.986681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 316/612] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:06 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1275 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:07.018617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-fe005302-ec2d-49f5-bd5e-30ec685a67e8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.145202 Aug 29 22:53:07.019213 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 297/613] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:53:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:07.360556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-98a44819-ce48-40b2-95f1-afd19219994a req-815fa33a-9e6b-4d9b-b3b2-87fe970275a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4382fa7b-f19c-4e64-bcb4-28994556231c", "tag": "4a7754e6-246d-4310-9f9e-5d280d55294e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:07.370551 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-98a44819-ce48-40b2-95f1-afd19219994a req-815fa33a-9e6b-4d9b-b3b2-87fe970275a8 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:07.371758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-98a44819-ce48-40b2-95f1-afd19219994a req-815fa33a-9e6b-4d9b-b3b2-87fe970275a8 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:07.372389 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-98a44819-ce48-40b2-95f1-afd19219994a req-815fa33a-9e6b-4d9b-b3b2-87fe970275a8 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:07.383503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-98a44819-ce48-40b2-95f1-afd19219994a req-815fa33a-9e6b-4d9b-b3b2-87fe970275a8 service nova] Creating event network-changed:4a7754e6-246d-4310-9f9e-5d280d55294e for instance 4382fa7b-f19c-4e64-bcb4-28994556231c on hv-cinder-85426 Aug 29 22:53:07.389317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-98a44819-ce48-40b2-95f1-afd19219994a req-815fa33a-9e6b-4d9b-b3b2-87fe970275a8 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032935 Aug 29 22:53:07.389912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 317/614] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:08.003773 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:08.004403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:08.006838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:08.011531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.012678 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.013148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.013785 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:08.014244 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:08.014676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:08.080102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:08.088844 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-82ee7c46-508b-4d1b-86c0-e6b598e7e492 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1275 microversion: 2.1 time: 0.089375 Aug 29 22:53:08.089404 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 298/615] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:07 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1275 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:09.111034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:09.111935 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:09.119218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.119752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.120188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.120922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:09.121485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:09.121909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:09.208384 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:09.218757 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-df3a0035-94af-4597-a2e5-659f16d8b311 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1285 microversion: 2.1 time: 0.113263 Aug 29 22:53:09.219974 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 318/616] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:09 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:09.799230 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-295883805", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3cbc22b7-19e9-4863-99a1-541b71beccc1"}], "security_groups": [{"name": "tempest-securitygroup--860530045"}], "key_name": "tempest-keypair-570855089", "user_data": "}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:09.937700 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] validate_networks() for [('3cbc22b7-19e9-4863-99a1-541b71beccc1', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:53:10.241354 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:10.242128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:10.249996 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.250590 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.251090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.251858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.252384 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.252919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.324602 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:10.336923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6fb6954a-d462-4bd5-b6fc-b5dffaf0d22f tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1273 microversion: 2.1 time: 0.096856 Aug 29 22:53:10.336923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 319/617] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:10 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1273 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:10.549644 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:53:10.550062 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:53:10.550527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:53:10.550928 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:53:10.551486 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:53:10.560922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.566276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.566276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.566276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:10.566276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:10.566687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:10.581416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:53:10.585866 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Getting quotas for user bcd83a222eb04368a409db06389f1b7d and project d106ca51e01f439f82fd71df4dc2ed71. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:53:10.597983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:53:10.600266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:53:10.769579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-87896e22-2ba9-435d-89eb-9d904630970b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.975047 Aug 29 22:53:10.770660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 299/618] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:53:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 977 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:53:10.782554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-05ac2493-70d1-4a8e-adaa-06d9312d94de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:10.783797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-05ac2493-70d1-4a8e-adaa-06d9312d94de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:10.876037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-05ac2493-70d1-4a8e-adaa-06d9312d94de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:10.881692 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-05ac2493-70d1-4a8e-adaa-06d9312d94de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1236 microversion: 2.1 time: 0.103612 Aug 29 22:53:10.882620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 320/619] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:10 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:11.358481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:11.359270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:11.365960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.369944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.369944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.369944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.369944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.370301 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.503421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:11.511145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3e8abdcf-427e-4a00-af01-e955fe029464 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.157804 Aug 29 22:53:11.512387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 300/620] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:11 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:11.903561 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:11.904199 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:11.906247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:11.911988 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.912461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.912924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.913656 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:11.914092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:11.914501 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:11.978114 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:11.986415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9ffcfc60-40a8-4d44-89d7-5f510b2e37b3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1240 microversion: 2.1 time: 0.087389 Aug 29 22:53:11.986972 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 321/621] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:11 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1240 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:12.532553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:12.533413 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:12.540401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.540927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.541366 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.542100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:12.542555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:12.542980 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:12.728081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:12.737042 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-bf654270-610a-427b-b0e9-31e3b24ab59b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.208601 Aug 29 22:53:12.737617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 301/622] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:12 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:13.007034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:13.007638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:13.014605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.015080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.015507 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.016185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.016627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.017065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.081416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:13.089693 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-275c0c2d-95a5-4239-8724-3d938cc2214c tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1240 microversion: 2.1 time: 0.086362 Aug 29 22:53:13.091025 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 322/623] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:13 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1240 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:13.391769 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-eedd36e4-3c25-4b3a-aa00-6fd7e7fca6b7 req-ac772378-dd4e-40c3-96cc-2f1640b2a6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "778693a7-58a0-4cb4-8c82-417b3c8b0c2a", "tag": "2aa355d8-26b7-4a57-848d-6eb620f9fb99"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:13.401703 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-eedd36e4-3c25-4b3a-aa00-6fd7e7fca6b7 req-ac772378-dd4e-40c3-96cc-2f1640b2a6cc service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.402187 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-eedd36e4-3c25-4b3a-aa00-6fd7e7fca6b7 req-ac772378-dd4e-40c3-96cc-2f1640b2a6cc service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.402738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-eedd36e4-3c25-4b3a-aa00-6fd7e7fca6b7 req-ac772378-dd4e-40c3-96cc-2f1640b2a6cc service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.414971 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-eedd36e4-3c25-4b3a-aa00-6fd7e7fca6b7 req-ac772378-dd4e-40c3-96cc-2f1640b2a6cc service nova] Creating event network-changed:2aa355d8-26b7-4a57-848d-6eb620f9fb99 for instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a on hv-cinder-85426 Aug 29 22:53:13.420212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-eedd36e4-3c25-4b3a-aa00-6fd7e7fca6b7 req-ac772378-dd4e-40c3-96cc-2f1640b2a6cc service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034638 Aug 29 22:53:13.420995 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 302/624] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:13.758485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:13.759116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:13.765722 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.766200 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.766627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.767313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:13.767757 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:13.768173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:13.906304 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:13.923107 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bccbec87-d97a-475f-a2ed-a8633f596b9c tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.168224 Aug 29 22:53:13.925263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 323/625] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:13 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:14.112491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:14.113963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:14.120271 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.120793 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.121753 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.122487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.122923 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.127848 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.247924 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:14.256226 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1cc2eb67-533e-4c6a-8687-0170e1cb42a4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1288 microversion: 2.1 time: 0.148437 Aug 29 22:53:14.271372 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 303/626] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:14 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1288 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:14.947627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:14.948237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:14.954826 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.955306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.955736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:14.956417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:14.956895 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:14.957316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.085905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:15.094529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0075ce21-b978-4dca-9582-a7a8c72fbcac tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.150788 Aug 29 22:53:15.095087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 324/627] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:14 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:15.279841 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:15.280484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:15.287241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.287799 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.288291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.289101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:15.289551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:15.289996 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:15.294498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=100 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:15.357294 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:15.365090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8660495b-b765-4e04-a073-c95b9a9d88ca tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1288 microversion: 2.1 time: 0.089867 Aug 29 22:53:15.365653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 304/628] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:15 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:16.116218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:16.116922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:16.123223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.123702 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.124136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.124862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.125319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.125744 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.389987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:16.390618 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:16.397344 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.397922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.398571 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.399968 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:16.400604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:16.401065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:16.417142 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:16.424530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0a7a5566-22e2-4dd0-af36-8823e39ecb02 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.312215 Aug 29 22:53:16.425137 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 325/629] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:16 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:16.519928 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:16.527606 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2a84d411-7849-42cf-80e7-32f8c1169315 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1288 microversion: 2.1 time: 0.142194 Aug 29 22:53:16.528427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 305/630] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:16 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1288 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:17.446105 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:17.446828 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:17.449106 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:17.454351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.454822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.455249 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.455921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.456383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.459935 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.548875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:17.549575 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:17.556085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.556647 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.557145 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.557851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:17.558298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:17.558743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:17.593721 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:17.601775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3ce2a753-8181-4d7d-92df-9233e982b059 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.159471 Aug 29 22:53:17.602361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 326/631] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:17 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:17.625158 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:17.632973 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-990b0ba3-4028-4a4a-ab6d-e70fc20f7cc4 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1288 microversion: 2.1 time: 0.087867 Aug 29 22:53:17.633537 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 306/632] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:17 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:18.623605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:18.624203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:18.630730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.631206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.631632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.632313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.632788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.633210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.655347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:18.656354 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:18.662891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.663491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.664028 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.664908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:18.665462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:18.665971 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:18.732888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:18.740986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1852d667-4602-4dc3-a4f4-ba6b3b1ca1ad tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1288 microversion: 2.1 time: 0.090083 Aug 29 22:53:18.742434 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 307/633] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:18 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1288 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:18.774124 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:18.782468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8c9712e9-0e4d-4bd1-b8cc-07fa10f7980b tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.163530 Aug 29 22:53:18.783153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 327/634] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:18 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:19.762489 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:19.763109 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:19.770849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.771332 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.771761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.772454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.772933 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.773350 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.807715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:19.808329 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:19.815905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.816394 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.816864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.817567 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:19.818017 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:19.818880 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:19.965000 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:19.973902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bde3ff37-0bbd-43c0-8956-b05e218c3eaf tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.170293 Aug 29 22:53:19.974500 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 328/635] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:19 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:20.011166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:20.019600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cf99c19e-42b9-4017-839d-d55d85189036 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.260979 Aug 29 22:53:20.020260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 308/636] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:19 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:20.696675 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-2da7cd84-705d-44c5-9a40-406738e4ce16 req-f0f88e91-c38e-4ab1-9cd2-b4763dfb0a54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5957a589-da27-4005-9715-51871f53c63c", "tag": "65cd327f-714d-410a-9959-d9a32027ba22"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:20.706673 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-2da7cd84-705d-44c5-9a40-406738e4ce16 req-f0f88e91-c38e-4ab1-9cd2-b4763dfb0a54 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:20.707151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-2da7cd84-705d-44c5-9a40-406738e4ce16 req-f0f88e91-c38e-4ab1-9cd2-b4763dfb0a54 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:20.707575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-2da7cd84-705d-44c5-9a40-406738e4ce16 req-f0f88e91-c38e-4ab1-9cd2-b4763dfb0a54 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:20.719614 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-2da7cd84-705d-44c5-9a40-406738e4ce16 req-f0f88e91-c38e-4ab1-9cd2-b4763dfb0a54 service nova] Creating event network-changed:65cd327f-714d-410a-9959-d9a32027ba22 for instance 5957a589-da27-4005-9715-51871f53c63c on hv-cinder-85426 Aug 29 22:53:20.725040 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-2da7cd84-705d-44c5-9a40-406738e4ce16 req-f0f88e91-c38e-4ab1-9cd2-b4763dfb0a54 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031919 Aug 29 22:53:20.727428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 329/637] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:20.995526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:20.996249 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:20.998737 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:20.999529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=12 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:21.005552 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.011583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.011583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.011583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.011583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.012015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.042564 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:21.043322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:21.045862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=10 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:21.051352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.051845 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.052282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.053018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:21.053469 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:21.053892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:21.191585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:21.200089 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7190af37-09da-4dd3-b5fe-226559543057 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.161386 Aug 29 22:53:21.202112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 330/638] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:21 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:21.321859 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:21.330815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-617ac2d6-1c9b-48ff-8741-ef2c7b5fadb5 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.339296 Aug 29 22:53:21.331411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 309/639] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:20 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:22.224781 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.225433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.232296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.232860 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.233298 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.234025 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.234479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.234903 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.351947 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.353065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.360142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.361039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.361347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.362152 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.363516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.364063 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.378715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:22.390706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-796c30f1-176a-4b53-829e-d8807adfd172 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.170641 Aug 29 22:53:22.391993 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 331/640] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:22 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:22.508311 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:22.516039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:22.519691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:22.520381 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-63f2dd71-3180-4a80-a466-f9231a49fae8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.172570 Aug 29 22:53:22.521196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 310/641] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:22 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:22.523443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.524113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.524701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.525692 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:22.526371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:22.526941 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:22.623369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lazy-loading 'services' on Instance uuid 22918c24-f85a-42ff-b152-35e097b65135 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:22.874725 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4648ec0a-ff3a-4f21-8f2a-fc7530217d73 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135/os-volume_attachments/a12b4ec3-b170-4499-b21f-be37e49ca0ea" status: 202 len: 0 microversion: 2.1 time: 0.363406 Aug 29 22:53:22.875316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 332/642] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:53:22 2022] DELETE /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135/os-volume_attachments/a12b4ec3-b170-4499-b21f-be37e49ca0ea => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:53:23.412970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:23.413532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:23.420572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.421083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.421528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.422291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.422763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.423188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.542270 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:23.543004 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:23.550263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.550745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.551174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.551870 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.552323 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.552759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.556775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:23.565453 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e790209a-dc72-45f2-b8d9-2912f50405aa tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.156515 Aug 29 22:53:23.566024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 311/643] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:23 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:23.689602 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:23.698099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f2d011b4-3611-45b3-ab28-fe62110cbfeb tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.159989 Aug 29 22:53:23.703893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 333/644] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:23 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:23.883393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-9db7002d-40e8-4fc0-8a62-afcf63661b95 req-c5a5e755-8f0b-4137-82a5-9cf5c9499bdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "778693a7-58a0-4cb4-8c82-417b3c8b0c2a", "name": "network-vif-plugged", "status": "completed", "tag": "2aa355d8-26b7-4a57-848d-6eb620f9fb99"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:23.893421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-9db7002d-40e8-4fc0-8a62-afcf63661b95 req-c5a5e755-8f0b-4137-82a5-9cf5c9499bdd service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:23.893899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-9db7002d-40e8-4fc0-8a62-afcf63661b95 req-c5a5e755-8f0b-4137-82a5-9cf5c9499bdd service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:23.894330 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-9db7002d-40e8-4fc0-8a62-afcf63661b95 req-c5a5e755-8f0b-4137-82a5-9cf5c9499bdd service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:23.906334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-9db7002d-40e8-4fc0-8a62-afcf63661b95 req-c5a5e755-8f0b-4137-82a5-9cf5c9499bdd service nova] Creating event network-vif-plugged:2aa355d8-26b7-4a57-848d-6eb620f9fb99 for instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a on hv-cinder-85426 Aug 29 22:53:23.911602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-9db7002d-40e8-4fc0-8a62-afcf63661b95 req-c5a5e755-8f0b-4137-82a5-9cf5c9499bdd service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031901 Aug 29 22:53:23.912210 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 312/645] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:24.002479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.003201 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.009188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.015542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.015542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.015542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.015542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.015938 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.027559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:24.039823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:53:24.395118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4a91f59a-8172-45c0-b60a-460c9b9b8ccf tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 204 len: 0 microversion: 2.1 time: 0.396295 Aug 29 22:53:24.395711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 334/646] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:53:23 2022] DELETE /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:53:24.405256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.405975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.412067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.412547 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.412999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.413678 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.414172 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.414590 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.551571 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:24.559422 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b8a267d1-a7bb-429e-8a10-40b7d47150b4 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1512 microversion: 2.1 time: 0.159135 Aug 29 22:53:24.560492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 313/647] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:24 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:24.587366 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.588064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.594692 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.595185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.595622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.596317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.596807 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.597235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.720477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:24.721129 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:24.727034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.727520 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.727956 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.728649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:24.729149 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:24.729557 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:24.732578 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:24.740586 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-154d5c90-8b82-4627-8bd5-020061560143 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.157679 Aug 29 22:53:24.741340 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 335/648] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:24 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:24.863420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:24.871020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5c5cb4d8-4f91-42b3-b441-427a3ce94dd0 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.154676 Aug 29 22:53:24.871580 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 314/649] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:24 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:25.581859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:25.582469 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:25.589274 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.589843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.590172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.590859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.591947 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.592373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.726359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:25.734221 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-50df7597-a095-483c-af54-e2d7855e5a1c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1512 microversion: 2.1 time: 0.156439 Aug 29 22:53:25.734861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 336/650] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:25 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1512 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:25.762223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:25.762847 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:25.769980 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.770465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.770901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.771598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.772055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.772478 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.892559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:25.893196 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:25.899202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.899686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.900106 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.900831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:25.901283 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:25.901698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:25.914586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:25.922912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-41533576-4557-45d6-8839-0985ea90590f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.164388 Aug 29 22:53:25.923585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 315/651] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:25 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:26.047587 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:26.055465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-115f9975-59f5-4b89-870a-2d6f99fee848 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1315 microversion: 2.1 time: 0.167405 Aug 29 22:53:26.056023 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 337/652] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:25 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:26.755305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:26.755905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:26.761780 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.762253 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.762807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.770817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:26.770817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:26.770817 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:26.897975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:26.906702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2ec5de6a-5934-4c96-86f9-a176da18dfec tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1512 microversion: 2.1 time: 0.155123 Aug 29 22:53:26.907368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 316/653] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:26 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:26.998651 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:26.999253 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.005301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.005830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.006203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.006874 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.007316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.007728 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.075797 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.076393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.083102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.083657 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.084090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.084804 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.085257 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.085935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.142305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:27.150050 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-35f172a7-5b9f-4227-afd1-d9da28afea5a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.210464 Aug 29 22:53:27.150620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 338/654] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:26 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:27.217411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:27.225876 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6caea382-8147-4cec-babc-dc26187cc0e7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1465 microversion: 2.1 time: 0.153886 Aug 29 22:53:27.226583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 317/655] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:27 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1465 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:27.274368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.274855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.281604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.282075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.282529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.283213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.283704 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.284135 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.310317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:53:27.612456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c6b814aa-3a57-4d78-a179-5b4ac081ed5e tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "DELETE /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 204 len: 0 microversion: 2.1 time: 0.341612 Aug 29 22:53:27.613110 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 339/656] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:53:27 2022] DELETE /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:53:27.621235 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.621856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.628225 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.628746 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.629178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.629872 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.630328 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.630751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.843633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:27.852232 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1b1ece65-cdde-4117-a641-2d23a8c87805 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1471 microversion: 2.1 time: 0.234665 Aug 29 22:53:27.852840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 318/657] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:27 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1471 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:27.881811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:27.884232 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.890377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.890857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.891291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.891984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.892446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.892896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.904611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-11ab12b2-866b-441d-bd51-bad1852cf745 req-f2bd307b-bab3-4619-b944-2581396d44d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5957a589-da27-4005-9715-51871f53c63c", "name": "network-vif-plugged", "status": "completed", "tag": "65cd327f-714d-410a-9959-d9a32027ba22"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:27.914765 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-11ab12b2-866b-441d-bd51-bad1852cf745 req-f2bd307b-bab3-4619-b944-2581396d44d3 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.915263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-11ab12b2-866b-441d-bd51-bad1852cf745 req-f2bd307b-bab3-4619-b944-2581396d44d3 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.915729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-11ab12b2-866b-441d-bd51-bad1852cf745 req-f2bd307b-bab3-4619-b944-2581396d44d3 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.928564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-11ab12b2-866b-441d-bd51-bad1852cf745 req-f2bd307b-bab3-4619-b944-2581396d44d3 service nova] Creating event network-vif-plugged:65cd327f-714d-410a-9959-d9a32027ba22 for instance 5957a589-da27-4005-9715-51871f53c63c on hv-cinder-85426 Aug 29 22:53:27.933421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-11ab12b2-866b-441d-bd51-bad1852cf745 req-f2bd307b-bab3-4619-b944-2581396d44d3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033255 Aug 29 22:53:27.934010 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 319/658] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:27.940036 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:27.940633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:27.947017 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.950053 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.957520 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:27.958272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:27.958740 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:27.959293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.062779 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:28.070820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1720f89e-dd2c-4985-9cf8-c0888f753dc1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1470 microversion: 2.1 time: 0.135632 Aug 29 22:53:28.071403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 320/659] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:27 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1470 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:28.076765 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-0167562e-2453-4196-b776-f7796fc29b14 req-ae2cb5b4-4397-4f3e-8e84-d1fe26e42160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22918c24-f85a-42ff-b152-35e097b65135", "name": "network-vif-deleted", "tag": "10c49fb7-bcd7-4f90-887a-94870952f162"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:28.087574 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0167562e-2453-4196-b776-f7796fc29b14 req-ae2cb5b4-4397-4f3e-8e84-d1fe26e42160 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.088044 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0167562e-2453-4196-b776-f7796fc29b14 req-ae2cb5b4-4397-4f3e-8e84-d1fe26e42160 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.088469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0167562e-2453-4196-b776-f7796fc29b14 req-ae2cb5b4-4397-4f3e-8e84-d1fe26e42160 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.099770 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-0167562e-2453-4196-b776-f7796fc29b14 req-ae2cb5b4-4397-4f3e-8e84-d1fe26e42160 service nova] Creating event network-vif-deleted:10c49fb7-bcd7-4f90-887a-94870952f162 for instance 22918c24-f85a-42ff-b152-35e097b65135 on hv-cinder-85426 Aug 29 22:53:28.104589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-0167562e-2453-4196-b776-f7796fc29b14 req-ae2cb5b4-4397-4f3e-8e84-d1fe26e42160 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031148 Aug 29 22:53:28.105203 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 321/660] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:28.141934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f2934edb-6ea1-49e4-8ba7-503195bfcb5a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/action" status: 202 len: 0 microversion: 2.1 time: 0.264276 Aug 29 22:53:28.142560 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 340/661] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:53:27 2022] POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:53:28.150773 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:28.151463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:28.158244 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.158723 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.159189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.159869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.160312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.160740 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.172768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:28.173473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:28.180213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.180693 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.181483 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.181875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.182325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.182739 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.312177 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:28.315835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=100 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:28.321428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-40775a9a-2c94-41c2-af6b-e7c18299f2a0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1751 microversion: 2.1 time: 0.174651 Aug 29 22:53:28.322011 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 322/662] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:28 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:28.322491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:28.331248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-89abcacb-72b5-44ec-9a89-1eb013bdd643 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.163564 Aug 29 22:53:28.331836 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 341/663] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:28 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:28.873922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:28.874528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:28.881154 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.881632 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.882060 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:28.882736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:28.883186 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:28.883630 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.021989 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:29.030819 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4fab0b40-7134-4776-b248-7f7cc5e20ee7 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1471 microversion: 2.1 time: 0.161023 Aug 29 22:53:29.031523 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 323/664] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:28 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:29.093237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:29.093763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:29.100433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.100942 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.101383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.102043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.102484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.102898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.169721 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:29.178064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e1d9b2e8-4f85-4852-ae08-9acfe973b88b tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1302 microversion: 2.1 time: 0.089042 Aug 29 22:53:29.178669 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 342/665] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:29 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1302 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:29.354127 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:29.354656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:29.361612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.362101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.362540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.363241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.363697 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.364181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.401694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:29.402302 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:29.409191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.409681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.410115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.410821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:29.411527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:29.411958 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:29.607008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:29.617975 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-710cc6f2-332a-4a4f-818c-a07321a456ca tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1751 microversion: 2.1 time: 0.220015 Aug 29 22:53:29.618756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 343/666] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:29 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1751 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:29.765056 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:29.773026 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-eb6db9e4-c227-42f2-b252-c522344b86a8 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.422854 Aug 29 22:53:29.773607 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 324/667] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:29 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:30.052297 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:30.053039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:30.059373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.059862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.060296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.061192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.064628 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.065383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.136995 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:30.145884 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-37b0ea96-3ba0-43f3-82f1-ee6a90769265 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1429 microversion: 2.1 time: 0.097359 Aug 29 22:53:30.146524 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 344/668] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:30 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1429 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:30.176181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-c95fd8e9-0848-49b8-8c7e-dd336dac2887 req-f8cc9f53-f94f-49b5-94a7-c7f17bb534ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "778693a7-58a0-4cb4-8c82-417b3c8b0c2a", "name": "network-vif-deleted", "tag": "2aa355d8-26b7-4a57-848d-6eb620f9fb99"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:30.187057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c95fd8e9-0848-49b8-8c7e-dd336dac2887 req-f8cc9f53-f94f-49b5-94a7-c7f17bb534ff service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.187611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c95fd8e9-0848-49b8-8c7e-dd336dac2887 req-f8cc9f53-f94f-49b5-94a7-c7f17bb534ff service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.188128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c95fd8e9-0848-49b8-8c7e-dd336dac2887 req-f8cc9f53-f94f-49b5-94a7-c7f17bb534ff service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.199396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:30.200632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:30.202537 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-c95fd8e9-0848-49b8-8c7e-dd336dac2887 req-f8cc9f53-f94f-49b5-94a7-c7f17bb534ff service nova] Creating event network-vif-deleted:2aa355d8-26b7-4a57-848d-6eb620f9fb99 for instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a on hv-cinder-85426 Aug 29 22:53:30.207812 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-c95fd8e9-0848-49b8-8c7e-dd336dac2887 req-f8cc9f53-f94f-49b5-94a7-c7f17bb534ff service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035386 Aug 29 22:53:30.208211 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.208427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 325/669] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:30.209063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.209654 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.211374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.212152 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.212577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.251376 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.251869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.252309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.252997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lazy-loading 'fault' on Instance uuid 22918c24-f85a-42ff-b152-35e097b65135 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:30.297180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:30.306653 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0e2f1e8d-9ad3-4d1b-bae8-074c74630960 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 200 len: 1307 microversion: 2.1 time: 0.110953 Aug 29 22:53:30.307212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 345/670] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:30 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 1307 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:30.641500 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:30.642196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:30.648375 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.648905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.649342 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.650107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.650565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.650984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.795178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:30.796413 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:30.802863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.803579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.804180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.804926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:30.805364 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:30.805784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:30.821970 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:30.927824 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:30.941370 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ccb12545-c2e2-4476-8169-2f53f0cadaf5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1751 microversion: 2.1 time: 0.304247 Aug 29 22:53:30.943600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 326/671] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:30 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1751 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:30.980411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:30.995104 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-766e5ce6-411a-4297-b5b0-4438280bb9d7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1361 microversion: 2.1 time: 0.201202 Aug 29 22:53:30.995821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 346/672] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:30 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:31.167504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:31.168031 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:31.174823 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.175327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.175732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.181911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.181911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.181911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.208072 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.208546 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.209021 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.209455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lazy-loading 'fault' on Instance uuid 778693a7-58a0-4cb4-8c82-417b3c8b0c2a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:31.250952 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:31.258904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-53c6e7fa-f886-4bbc-aacc-31b0dee28f22 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1305 microversion: 2.1 time: 0.095370 Aug 29 22:53:31.259469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 327/673] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:31 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1305 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:31.329221 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:31.330722 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: 22918c24-f85a-42ff-b152-35e097b65135] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:31.337586 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.338070 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.338503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.339191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.339642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.340061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.355467 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] HTTP exception thrown: Instance 22918c24-f85a-42ff-b152-35e097b65135 could not be found. Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Request method failure captured: Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 HTTP/1.1 Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUMJHFEX4Cpq4v4fUueJK5BgptXbGT7uhqZ2LocW_e90nkoMfcsSVubo9RfZl5UGRWKjcmswjZd8mkpG1FFFM2ufdVheHOcw1XhupPUHjhHsDQza5zMOHNRsqIukcRQPjtqpM3z9tXvPyvuLBoqYcZZBMsz63HDVRhzhOh9dciA5otg Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: a8c824e8723341808544a577b85d9b2d Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1526487074 Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:53:31.357144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8c824e8723341808544a577b85d9b2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8c824e8723341808544a577b85d9b2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8c824e8723341808544a577b85d9b2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8c824e8723341808544a577b85d9b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-VolumesSnapshotTestJSON-1526487074 Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: a8c824e8723341808544a577b85d9b2d Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1526487074 Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-VolumesSnapshotTestJSON-1526487074-project Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 70cf6f471ff04dab9f8cbc268397928e Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-VolumesSnapshotTestJSON-1526487074-project Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 22918c24-f85a-42ff-b152-35e097b65135 could not be found. Aug 29 22:53:31.358554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '22918c24-f85a-42ff-b152-35e097b65135'} Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22918c24-f85a-42ff-b152-35e097b65135 could not be found. Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:53:31.360446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22918c24-f85a-42ff-b152-35e097b65135 could not be found. Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22918c24-f85a-42ff-b152-35e097b65135 could not be found. Aug 29 22:53:31.361929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:31.363416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Returning 404 to user: Instance 22918c24-f85a-42ff-b152-35e097b65135 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:53:31.363416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-82bc1f05-9b71-47bc-b82a-dcf43daab53c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135" status: 404 len: 111 microversion: 2.1 time: 0.033763 Aug 29 22:53:31.363416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 347/674] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:31 2022] GET /compute/v2.1/servers/22918c24-f85a-42ff-b152-35e097b65135 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:31.962952 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:31.963554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:31.970582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.971150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.971579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:31.972269 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:31.972735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:31.973157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.017743 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:32.018367 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:32.024196 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.024670 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.025127 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.025806 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.026251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.026692 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.126732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:32.135301 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4b1fca5d-0075-4bde-bcd6-fbb17443957d tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.176423 Aug 29 22:53:32.135887 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 328/675] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:31 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:32.160212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:32.167976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4b0735ec-a0cf-4e7c-bc0d-b3761903b885 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1547 microversion: 2.1 time: 0.154842 Aug 29 22:53:32.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 348/676] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:32 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:32.188736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:32.189265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:32.195517 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.195998 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.196433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.197278 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.197742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.198169 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.283685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:32.284318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:32.287165 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d1e1cc3d-b10d-4188-b11d-f9b3456b48ff tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102669 Aug 29 22:53:32.287976 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 329/677] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:53:32 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:32.290646 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.291209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.291678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.292347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.292813 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.293231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.326707 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:32.327101 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:32.328063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:32.328521 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lazy-loading 'fault' on Instance uuid 778693a7-58a0-4cb4-8c82-417b3c8b0c2a {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:32.375055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:32.384511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4102ed64-3919-4172-a9cd-800a391b44a8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1305 microversion: 2.1 time: 0.107615 Aug 29 22:53:32.385409 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 349/678] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:32 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:33.158447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:33.159093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:33.165034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.165507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.165931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.166612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.167052 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.167464 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.406404 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:33.406921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:33.414080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.414557 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.414980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.415661 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.416103 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.416514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.432055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:33.441593 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b2d787dc-62d9-4c4e-a69e-ea0f81e7900b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.287515 Aug 29 22:53:33.442172 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 330/679] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:33 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:33.450224 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.455430 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.456008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.456484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lazy-loading 'fault' on Instance uuid 778693a7-58a0-4cb4-8c82-417b3c8b0c2a {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:33.508286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:33.517401 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b918eddc-10fd-4ecb-986e-f258f677bfa8 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1305 microversion: 2.1 time: 0.114975 Aug 29 22:53:33.517987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 350/680] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:33 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1305 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:33.750842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-5c138e7b-6f3c-4efc-b41c-855208e5681c req-c005e7c8-e9fe-446b-94f7-3b7bfbef6c0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5957a589-da27-4005-9715-51871f53c63c", "tag": "65cd327f-714d-410a-9959-d9a32027ba22"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:33.760524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-5c138e7b-6f3c-4efc-b41c-855208e5681c req-c005e7c8-e9fe-446b-94f7-3b7bfbef6c0c service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.761262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-5c138e7b-6f3c-4efc-b41c-855208e5681c req-c005e7c8-e9fe-446b-94f7-3b7bfbef6c0c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.761747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-5c138e7b-6f3c-4efc-b41c-855208e5681c req-c005e7c8-e9fe-446b-94f7-3b7bfbef6c0c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.774082 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-5c138e7b-6f3c-4efc-b41c-855208e5681c req-c005e7c8-e9fe-446b-94f7-3b7bfbef6c0c service nova] Creating event network-changed:65cd327f-714d-410a-9959-d9a32027ba22 for instance 5957a589-da27-4005-9715-51871f53c63c on hv-cinder-85426 Aug 29 22:53:33.779174 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-5c138e7b-6f3c-4efc-b41c-855208e5681c req-c005e7c8-e9fe-446b-94f7-3b7bfbef6c0c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032225 Aug 29 22:53:33.780163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 331/681] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:33.974923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:33.975565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:33.981941 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.982667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.983215 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:33.984135 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:33.985063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:33.985760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.071478 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'services' on Instance uuid d3390881-2a07-4dfd-a9e3-d17318cf8441 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:34.320157 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7636e183-7093-48e6-a2cd-9190e3fa506d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments/1b93ac17-a378-4a13-a926-f771d85d56b0" status: 202 len: 0 microversion: 2.1 time: 0.349581 Aug 29 22:53:34.320949 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 351/682] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:53:33 2022] DELETE /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments/1b93ac17-a378-4a13-a926-f771d85d56b0 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:53:34.330680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:34.333055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:34.339489 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.339976 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.340418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.341142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.341598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.342024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.374268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0c5e390a-90a6-4c8d-9fd0-226aeada1f89 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048744 Aug 29 22:53:34.374912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 332/683] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:34 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:34.464692 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:34.466212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:34.478756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.479242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.479675 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.480361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.480844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.481251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.567351 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:34.567750 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:34.574050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.580904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.580904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.580904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.580904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.581411 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.616567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:34.617365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:34.617796 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:34.618239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lazy-loading 'fault' on Instance uuid 778693a7-58a0-4cb4-8c82-417b3c8b0c2a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:34.641734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:34.650415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-87a61d84-039f-49b1-b9d4-0309cc3497bd tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.190570 Aug 29 22:53:34.650985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 352/684] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:34 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:34.667504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '785d6ff244c841df97f5b3cbfc56d8d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dacdd3e7b3240aabacdf5c385d5b9b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:34.675853 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8ddf1f8d-c03c-4ef0-8aec-7b66daaffe2a tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 200 len: 1305 microversion: 2.1 time: 0.112703 Aug 29 22:53:34.676418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 333/685] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:34 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:35.387153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:35.389369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:35.396289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.396824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.397257 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.397944 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.398392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.398809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.428203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1403f12d-1e07-4d12-b0b6-457fd62d46d1 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Aug 29 22:53:35.428760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 353/686] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:35 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:35.674040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:35.674668 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:35.681539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.682025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.682456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.683152 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.683606 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.684143 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.699680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:35.701136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] [instance: 778693a7-58a0-4cb4-8c82-417b3c8b0c2a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:35.709253 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.710103 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.711056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.712093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:35.713573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:35.715051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:35.733029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] HTTP exception thrown: Instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a could not be found. Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Request method failure captured: Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a HTTP/1.1 Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUNKnkpaXqicBXWuAsKvOREla_KZ-3ULN4zgvkPvGxmZNou2ZxhwHIDhIxewgF7HK9khQHP1zUjYKnEQaHpCKu4H2x4_PZv-KIGkDohdTH6HpvZjk4Mpt-55Y2PTZAtJ09aw7vYfQaWgFHXQriQFzibBjBOajoGQ3rKBC7op1vSJcDU Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 3dacdd3e7b3240aabacdf5c385d5b9b2 Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-VolumesNegativeTest-695010953 Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:53:35.736251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_3dacdd3e7b3240aabacdf5c385d5b9b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/3dacdd3e7b3240aabacdf5c385d5b9b2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3dacdd3e7b3240aabacdf5c385d5b9b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/3dacdd3e7b3240aabacdf5c385d5b9b2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-VolumesNegativeTest-695010953 Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 3dacdd3e7b3240aabacdf5c385d5b9b2 Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-VolumesNegativeTest-695010953 Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-VolumesNegativeTest-695010953-project Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 785d6ff244c841df97f5b3cbfc56d8d9 Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-VolumesNegativeTest-695010953-project Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a could not be found. Aug 29 22:53:35.737914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '778693a7-58a0-4cb4-8c82-417b3c8b0c2a'} Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a could not be found. Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:53:35.738842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a could not be found. Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a could not be found. Aug 29 22:53:35.740205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:35.741482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] Returning 404 to user: Instance 778693a7-58a0-4cb4-8c82-417b3c8b0c2a could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:53:35.741482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-30e87fe5-e2aa-4a33-a5b9-116da08816b3 tempest-VolumesNegativeTest-695010953 tempest-VolumesNegativeTest-695010953-project] 10.222.0.52 "GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a" status: 404 len: 111 microversion: 2.1 time: 0.044031 Aug 29 22:53:35.741482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 354/687] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:35 2022] GET /compute/v2.1/servers/778693a7-58a0-4cb4-8c82-417b3c8b0c2a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:53:36.008606 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:36.018753 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-486969d0-6fe2-4e1a-9bfe-9f8a78354c54 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.349307 Aug 29 22:53:36.019519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 334/688] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:35 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:36.441426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:36.443811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:36.449822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.450368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.450864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.451566 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.452061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.454172 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.483939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cadaf894-73a5-4358-b319-12f4b37b17c9 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048286 Aug 29 22:53:36.484575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 355/689] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:53:36 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:53:36.565542 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:36.566028 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:36.571869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.572338 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.572798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.573472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:36.573916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:36.574329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:36.601357 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:53:36.982254 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:37.044542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:37.046025 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:37.053276 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.054230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.054700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.055600 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.056048 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.056466 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.088907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-247387ce-5128-4523-8836-eea3c63cc0dd tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 204 len: 0 microversion: 2.1 time: 0.527476 Aug 29 22:53:37.089754 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 335/690] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:53:36 2022] DELETE /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:53:37.099138 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:37.099844 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:37.105885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.106514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.107241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.108008 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:37.108525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:37.109040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:37.241321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:37.250027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-560720f1-2a5f-4471-bae7-a8adf430f77a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.210460 Aug 29 22:53:37.251576 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 356/691] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:37 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:37.259578 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:37.268556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-900d2239-88d6-4d51-bf22-41ce52a2b265 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1688 microversion: 2.1 time: 0.174520 Aug 29 22:53:37.269166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 336/692] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:37 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:38.272537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:38.274064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:38.285073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.285073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.285073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.285073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.285400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.285400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.290980 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:38.291821 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:38.299587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.300093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.300560 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.301383 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:38.302136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:38.302571 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:38.438658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:38.441701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:38.447186 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7b0f3f22-83c8-4416-b4bf-d43163d8902b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.178365 Aug 29 22:53:38.447758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 357/693] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:38 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:38.451385 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e3dc903f-2392-4a39-8134-0f7a6b2b120a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1688 microversion: 2.1 time: 0.165312 Aug 29 22:53:38.452131 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 337/694] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:38 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:39.469298 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:39.469948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:39.477106 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.477707 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.478143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.478837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.479285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.479705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.480835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:39.481584 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:39.488823 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.489300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.489813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.490498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:39.490944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:39.491360 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:39.636397 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:39.639424 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:39.645629 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cf2929d7-2ccd-4909-8bab-483e04d17ef8 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1688 microversion: 2.1 time: 0.168514 Aug 29 22:53:39.655877 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 338/695] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:39 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1688 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:39.669924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:39.678352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b20234c0-1d9f-4a52-8122-f051f4742184 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.212931 Aug 29 22:53:39.678948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 358/696] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:39 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:40.667671 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:40.668392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:40.675305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.675784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.676208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.676930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.677374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.677820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.701800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:40.702528 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:40.710176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.711176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.711830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.712607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:40.713204 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:40.714093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:40.820946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:40.828627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4ad4e6b7-9db8-49b6-b939-4d418c0fd449 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1688 microversion: 2.1 time: 0.165296 Aug 29 22:53:40.829223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 339/697] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:40 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1688 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:40.870229 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:40.879162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4f80ad45-e47b-4944-bf7d-0254e7c85684 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.182217 Aug 29 22:53:40.879727 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 359/698] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:40 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:41.851414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:41.851939 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:41.858953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.859686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.860122 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.860850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.861497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.862458 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.899985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:41.900595 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:41.907241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.907739 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.908167 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:41.909637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:41.909992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:41.917025 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.087159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:42.099856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d95df828-eced-4900-b411-eb770d36ae68 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.203062 Aug 29 22:53:42.101817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 360/699] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:41 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:42.174801 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-607781587", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "networks": [{"uuid": "7214298d-8b6f-46bb-9406-ec92ab2d115a"}]}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:42.232800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] validate_networks() for [('7214298d-8b6f-46bb-9406-ec92ab2d115a', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:53:42.383804 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:42.391755 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-455dd9ca-d1dd-4192-87af-a00e1317916d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1688 microversion: 2.1 time: 0.544261 Aug 29 22:53:42.392340 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 340/700] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:41 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1688 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:42.652334 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:53:42.652762 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:53:42.653223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:53:42.653618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:53:42.654021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:53:42.663582 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.664051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.664475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.665210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:42.665652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:42.666063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:42.774708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Getting quotas for project a8c824e8723341808544a577b85d9b2d. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:53:42.778723 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Getting quotas for user 70cf6f471ff04dab9f8cbc268397928e and project a8c824e8723341808544a577b85d9b2d. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:53:42.791107 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:53:42.804012 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:53:42.804569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:42.941566 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cbe57ac8-7505-4646-947d-e6ef2e8de973 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.771015 Aug 29 22:53:42.950361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 361/701] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:53:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:53:42.957272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-75562bf4-5b7e-4128-b102-d68f99f85851 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:42.958508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-75562bf4-5b7e-4128-b102-d68f99f85851 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:43.070435 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-75562bf4-5b7e-4128-b102-d68f99f85851 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:43.081299 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-bdcfda1a-b397-43f3-962d-dfdacf3cff09 req-d1e46296-c02c-4025-ae37-180a8805a43e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3390881-2a07-4dfd-a9e3-d17318cf8441", "name": "network-vif-deleted", "tag": "d5317cad-0fae-4b42-bce5-918aa12399dd"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:43.082997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-75562bf4-5b7e-4128-b102-d68f99f85851 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1218 microversion: 2.1 time: 0.130840 Aug 29 22:53:43.105330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bdcfda1a-b397-43f3-962d-dfdacf3cff09 req-d1e46296-c02c-4025-ae37-180a8805a43e service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.105330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bdcfda1a-b397-43f3-962d-dfdacf3cff09 req-d1e46296-c02c-4025-ae37-180a8805a43e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.105539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 341/702] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:42 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:43.105641 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bdcfda1a-b397-43f3-962d-dfdacf3cff09 req-d1e46296-c02c-4025-ae37-180a8805a43e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.122530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:43.123194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:43.128612 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-bdcfda1a-b397-43f3-962d-dfdacf3cff09 req-d1e46296-c02c-4025-ae37-180a8805a43e service nova] Creating event network-vif-deleted:d5317cad-0fae-4b42-bce5-918aa12399dd for instance d3390881-2a07-4dfd-a9e3-d17318cf8441 on hv-cinder-85426 Aug 29 22:53:43.134308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-bdcfda1a-b397-43f3-962d-dfdacf3cff09 req-d1e46296-c02c-4025-ae37-180a8805a43e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058138 Aug 29 22:53:43.138821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 362/703] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:43.159254 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.164099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.164886 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.165899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.166521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.167107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.361102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:43.371084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0b6972fd-4497-4a2a-b3a0-55818457cd75 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.252399 Aug 29 22:53:43.371670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 342/704] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:43 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:43.417374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:43.418264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:43.424833 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.425335 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.425797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.427211 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.427841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.428268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.477934 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:43.478526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:43.479029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:43.479491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'fault' on Instance uuid d3390881-2a07-4dfd-a9e3-d17318cf8441 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:43.523650 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:43.532685 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-903f9436-3268-4e77-9055-f0f5488b72fe tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1334 microversion: 2.1 time: 0.122006 Aug 29 22:53:43.549971 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 363/705] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:43 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:44.105142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d70f2945-d4bd-4ed8-a8c3-005c44f5cf22 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:44.106013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d70f2945-d4bd-4ed8-a8c3-005c44f5cf22 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:44.165857 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d70f2945-d4bd-4ed8-a8c3-005c44f5cf22 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:44.174090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d70f2945-d4bd-4ed8-a8c3-005c44f5cf22 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1218 microversion: 2.1 time: 0.072696 Aug 29 22:53:44.174889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 343/706] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:44 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:44.393312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:44.394360 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:44.401719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.409490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.410262 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.411206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.411859 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.412659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.415992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:44.557415 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:44.562759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:44.564484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.565658 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.566387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.567095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.567583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.568018 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.589080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:44.606882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:44.606882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:44.606882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:44.606882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'fault' on Instance uuid d3390881-2a07-4dfd-a9e3-d17318cf8441 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:44.657910 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:44.665499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d2d2def8-f9e9-45bd-95d7-357db96daf9b tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 200 len: 1334 microversion: 2.1 time: 0.111863 Aug 29 22:53:44.665663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8853b0d3-8ab8-4123-a659-3e7aca7973b0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.276076 Aug 29 22:53:44.666015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 344/707] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:44 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:44.668459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 364/708] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:44 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:45.195075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:45.195858 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:45.202718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.203463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.203908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.205304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.205763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.206365 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.284527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:45.292236 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3b452355-aba4-4c47-a0af-249c3798cf59 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1270 microversion: 2.1 time: 0.101282 Aug 29 22:53:45.294863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 345/709] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:45 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:45.686673 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:45.686933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:45.687377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:45.687534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: d3390881-2a07-4dfd-a9e3-d17318cf8441] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:45.693479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.693981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.694188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.694412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.694678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.695091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.695217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.695535 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.695789 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:45.695948 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.696239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:45.696660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:45.711612 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] HTTP exception thrown: Instance d3390881-2a07-4dfd-a9e3-d17318cf8441 could not be found. Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Request method failure captured: Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 HTTP/1.1 Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI_fx_ax7hXaVFnEIBOJPme5Yx-yHAOZEe7ob7RyetMxYxlOOq1u_Vs5fNJRAziZfgejU9-7rcscOUfjEh4uk-HAA3fex7iX8gvxmh5D1Slue9mJZCfARw4zI6mr2xg0Rf8e8bZRPhXgtGx4NduV7AOki27W8KNUFzfDUXD-wgvd10 Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:53:45.713309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 53f9f8eb7a20431ca0d679af45946bce Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance d3390881-2a07-4dfd-a9e3-d17318cf8441 could not be found. Aug 29 22:53:45.715046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'd3390881-2a07-4dfd-a9e3-d17318cf8441'} Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3390881-2a07-4dfd-a9e3-d17318cf8441 could not be found. Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:53:45.715809 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3390881-2a07-4dfd-a9e3-d17318cf8441 could not be found. Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3390881-2a07-4dfd-a9e3-d17318cf8441 could not be found. Aug 29 22:53:45.717344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:53:45.719397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Returning 404 to user: Instance d3390881-2a07-4dfd-a9e3-d17318cf8441 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:53:45.719397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1f9914c7-2e49-4b18-92c1-37d5ef174ff4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441" status: 404 len: 111 microversion: 2.1 time: 0.031914 Aug 29 22:53:45.719397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 365/710] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:45 2022] GET /compute/v2.1/servers/d3390881-2a07-4dfd-a9e3-d17318cf8441 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 22:53:45.727471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-79b9790d-118e-40a1-8b8a-8d00af00d2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '.version_select at 0x7efc5fc491f0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:45.874594 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:45.883526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6023636d-e51b-4343-a9fe-91b9ac7f5dbc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.200662 Aug 29 22:53:45.888153 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 346/711] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:45 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:45.897142 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-79b9790d-118e-40a1-8b8a-8d00af00d2a4 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-178879431" status: 202 len: 0 microversion: 2.1 time: 0.175209 Aug 29 22:53:45.898050 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 366/712] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Aug 29 22:53:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-178879431 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:53:46.316195 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:46.317652 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:46.325422 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.326528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.327059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.327981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.328529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.329102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.472360 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:46.481502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8b804877-9033-4260-9799-c7549fe011aa tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1278 microversion: 2.1 time: 0.170707 Aug 29 22:53:46.482068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 347/713] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:46 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1278 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:46.906912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:46.908613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:46.916408 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.916931 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.917365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:46.918068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:46.918519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:46.918939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.155131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:47.166085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e6b2d054-be46-4140-9fe8-582e9f2e48bf tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.263839 Aug 29 22:53:47.167990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 367/714] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:46 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:47.502938 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:47.504493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:47.514616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.515703 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.516337 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.517213 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:47.517827 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:47.518325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:47.676385 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:47.690036 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a41aca87-5e85-42ed-9d2e-20f117061167 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.190796 Aug 29 22:53:47.691949 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 348/715] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:47 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:48.203008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:48.203008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:48.213247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.214000 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.214648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.215541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.216156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.216742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.447751 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:48.456332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b88ecb5a-023c-4551-a917-8ab020d8a0aa tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.268295 Aug 29 22:53:48.462050 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 368/716] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:48 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:48.642471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-d51bdfbb-39b8-4d92-a11f-ad9dd0bce7e6 req-e7194496-6e7b-4755-9a9e-ff618882ee06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7521284-b51c-49f4-96d5-549f7264930a", "tag": "073b17c6-c60c-4033-bd71-9e7065aad2c0"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:48.655694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-d51bdfbb-39b8-4d92-a11f-ad9dd0bce7e6 req-e7194496-6e7b-4755-9a9e-ff618882ee06 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.660085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-d51bdfbb-39b8-4d92-a11f-ad9dd0bce7e6 req-e7194496-6e7b-4755-9a9e-ff618882ee06 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.660085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-d51bdfbb-39b8-4d92-a11f-ad9dd0bce7e6 req-e7194496-6e7b-4755-9a9e-ff618882ee06 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.670472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-d51bdfbb-39b8-4d92-a11f-ad9dd0bce7e6 req-e7194496-6e7b-4755-9a9e-ff618882ee06 service nova] Creating event network-changed:073b17c6-c60c-4033-bd71-9e7065aad2c0 for instance c7521284-b51c-49f4-96d5-549f7264930a on hv-cinder-85426 Aug 29 22:53:48.675735 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-d51bdfbb-39b8-4d92-a11f-ad9dd0bce7e6 req-e7194496-6e7b-4755-9a9e-ff618882ee06 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036997 Aug 29 22:53:48.676501 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 349/717] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:48.713531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:48.714326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:48.721737 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.722740 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.731440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.731440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:48.731440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:48.731440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:48.885645 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:48.901062 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-100e56d1-0083-4624-8137-b23b3b3d85ed tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.187992 Aug 29 22:53:48.901062 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 369/718] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:48 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:49.481760 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:49.482988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:49.490855 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.493355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.493355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.493355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.493790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.494456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.668051 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:49.678840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-46e2783c-1a50-4dd8-ac74-b83360da5f21 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.201769 Aug 29 22:53:49.679477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 350/719] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:49 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:49.805906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:49.806944 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:49.813773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.814487 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.814955 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.815718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.816758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.817190 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.844526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:53:49.921251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:49.922122 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:49.928431 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.928948 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.929379 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:49.930070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:49.930519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:49.930947 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.091037 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:50.101719 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e8d96881-7ab4-4a86-bef5-6ccf6860a315 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.184281 Aug 29 22:53:50.102590 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 351/720] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:49 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:50.235223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-34ec1fdf-a23c-4b13-9cf2-34ff98ca7334 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 204 len: 0 microversion: 2.1 time: 0.432887 Aug 29 22:53:50.235945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 370/721] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:53:49 2022] DELETE /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:53:50.244882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:50.245839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:50.252635 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.254105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.255046 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.255977 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.256630 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.257285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.414586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:50.423405 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d6284c7d-8ce7-4ad5-93db-821cfa77f642 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1507 microversion: 2.1 time: 0.182331 Aug 29 22:53:50.426653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 352/722] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:50 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:50.702457 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:50.703263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:50.711711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.712632 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.713475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.714278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:50.714942 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:50.715459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:50.983939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:50.995602 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-eb220daf-c5b0-4a34-bc91-fdeb9221ece3 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.297603 Aug 29 22:53:51.000394 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 371/723] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:50 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:51.123559 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:51.124576 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:51.133305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.134117 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.134719 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.135642 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.136110 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.136543 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.311853 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:51.322878 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ab945712-1737-4172-a6bc-e38738a7894c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.203603 Aug 29 22:53:51.323480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 353/724] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:51 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:51.445399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:51.446049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:51.452016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.452491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.453013 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.453898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:51.454346 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:51.454758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:51.596180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:51.608285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-50a72ac9-1715-483f-ab1f-9a2cf354e3e5 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1507 microversion: 2.1 time: 0.166800 Aug 29 22:53:51.609125 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 372/725] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:51 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:52.019986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:52.021129 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:52.027157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.027321 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.027619 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.028314 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.028800 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.029228 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.194377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:52.202690 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ce77172a-a6e1-4cdd-9f27-6914a19f0676 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.186992 Aug 29 22:53:52.203252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 354/726] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:52 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:52.343702 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:52.344382 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:52.352168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.352679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.353121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.353817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.354267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.354686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.495138 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:52.504420 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-861fc0d4-efb1-47f3-a719-53c710e8a064 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.164372 Aug 29 22:53:52.505049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 373/727] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:52 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:52.631201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:52.631725 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:52.640304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.640304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.640304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.640304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:52.640642 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:52.640642 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:52.803576 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:52.811730 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e2ac3fb6-5301-4905-a7ea-d123eb060309 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1507 microversion: 2.1 time: 0.184567 Aug 29 22:53:52.812287 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 355/728] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:52 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:53.224991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:53.225598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:53.228885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:53.229866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:53.233639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.234325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.235013 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.235777 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.236481 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.237253 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.424049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:53.432486 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-790197ba-aab9-4d39-9635-f527e8919f2a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1756 microversion: 2.1 time: 0.211675 Aug 29 22:53:53.433086 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 374/729] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:53 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1756 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:53.527506 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:53.529239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:53.537987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.546216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.547100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.548033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.548506 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.549025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.835012 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:53.835885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:53.850094 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.850897 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.851509 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.852218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:53.852670 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:53.853116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:53.978940 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:53.987567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-33849bc9-6c53-4d37-b9ee-438d94833b12 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.464561 Aug 29 22:53:54.003069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 356/730] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:53 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:54.008475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:54.017767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2e7b6f38-66f0-42be-a06f-52a39e1c33c2 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1507 microversion: 2.1 time: 0.187076 Aug 29 22:53:54.019404 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 375/731] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:53 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:54.178403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=4 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:54.467476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-73212be3-ec44-47ab-a870-4dcc0ed32cae req-6d7de979-fddb-4535-8b37-0c3b602f7595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "786e5dbf-c75c-4eda-a2f6-ecfab5041eff", "name": "network-vif-deleted", "tag": "56d72164-e144-4a4d-8603-3e2ad709ea0b"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:54.487126 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-73212be3-ec44-47ab-a870-4dcc0ed32cae req-6d7de979-fddb-4535-8b37-0c3b602f7595 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.487607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-73212be3-ec44-47ab-a870-4dcc0ed32cae req-6d7de979-fddb-4535-8b37-0c3b602f7595 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.495115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-73212be3-ec44-47ab-a870-4dcc0ed32cae req-6d7de979-fddb-4535-8b37-0c3b602f7595 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.514658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-73212be3-ec44-47ab-a870-4dcc0ed32cae req-6d7de979-fddb-4535-8b37-0c3b602f7595 service nova] Creating event network-vif-deleted:56d72164-e144-4a4d-8603-3e2ad709ea0b for instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff on hv-cinder-85426 Aug 29 22:53:54.530451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-73212be3-ec44-47ab-a870-4dcc0ed32cae req-6d7de979-fddb-4535-8b37-0c3b602f7595 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.314754 Aug 29 22:53:54.530451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 376/732] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:53:54.540753 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:54.544983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:54.555256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.563140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.563140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.568457 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.569347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.573018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.605468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:54.606577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:54.616340 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.621889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.622554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.623607 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:54.627781 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:54.633976 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:54.688327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-914e1b65-3bcc-4736-b0a7-e48be889ced5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/ips" status: 200 len: 153 microversion: 2.20 time: 0.642528 Aug 29 22:53:54.710612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 357/733] 10.222.0.52 () {60 vars in 1289 bytes} [Mon Aug 29 22:53:54 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/ips => generated 153 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:53:55.012228 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:55.012904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:55.033772 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.036139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.036609 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.037387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.037908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.038293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.047888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=100 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:55.118513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:55.135499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7c2014eb-0858-4319-95dc-8c88c55d6ae6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1759 microversion: 2.1 time: 0.602388 Aug 29 22:53:55.136109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 377/734] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:54 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1759 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:55.152580 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:55.152580 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:55.166414 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.166923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.167601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.168475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.169120 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.169705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.207924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:55.208655 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:55.209282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:55.209895 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'fault' on Instance uuid 786e5dbf-c75c-4eda-a2f6-ecfab5041eff {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:55.255985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:55.261251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5a6c98cd-3d7f-4091-a798-f781b44e59c5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.254818 Aug 29 22:53:55.262789 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 358/735] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:55 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:55.267858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:55.278919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e519c389-49bb-48ff-9dca-7044d85030a6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 200 len: 1311 microversion: 2.1 time: 0.139931 Aug 29 22:53:55.279802 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 378/736] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:55 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 1311 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:56.288281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-0c8654ed-2875-4691-b1c4-a59bec2ff4b8 req-a37e2f52-f96b-45c5-b15b-6fbd8f0a183a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7521284-b51c-49f4-96d5-549f7264930a", "name": "network-vif-plugged", "status": "completed", "tag": "073b17c6-c60c-4033-bd71-9e7065aad2c0"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:56.290731 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.291346 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.308460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.308972 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.309399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.310091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.310531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.310939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.318232 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0c8654ed-2875-4691-b1c4-a59bec2ff4b8 req-a37e2f52-f96b-45c5-b15b-6fbd8f0a183a service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.318454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0c8654ed-2875-4691-b1c4-a59bec2ff4b8 req-a37e2f52-f96b-45c5-b15b-6fbd8f0a183a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.318861 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-0c8654ed-2875-4691-b1c4-a59bec2ff4b8 req-a37e2f52-f96b-45c5-b15b-6fbd8f0a183a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.341831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-0c8654ed-2875-4691-b1c4-a59bec2ff4b8 req-a37e2f52-f96b-45c5-b15b-6fbd8f0a183a service nova] Creating event network-vif-plugged:073b17c6-c60c-4033-bd71-9e7065aad2c0 for instance c7521284-b51c-49f4-96d5-549f7264930a on hv-cinder-85426 Aug 29 22:53:56.350944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-0c8654ed-2875-4691-b1c4-a59bec2ff4b8 req-a37e2f52-f96b-45c5-b15b-6fbd8f0a183a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070236 Aug 29 22:53:56.353199 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 359/737] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:53:56.360403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.361157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 786e5dbf-c75c-4eda-a2f6-ecfab5041eff] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.373218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.374075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.374755 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.375701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.376382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.377050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.396881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] HTTP exception thrown: Instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff could not be found. Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Request method failure captured: Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff HTTP/1.1 Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI_fx_ax7hXaVFnEIBOJPme5Yx-yHAOZEe7ob7RyetMxYxlOOq1u_Vs5fNJRAziZfgejU9-7rcscOUfjEh4uk-HAA3fex7iX8gvxmh5D1Slue9mJZCfARw4zI6mr2xg0Rf8e8bZRPhXgtGx4NduV7AOki27W8KNUFzfDUXD-wgvd10 Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:53:56.399401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 53f9f8eb7a20431ca0d679af45946bce Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff could not be found. Aug 29 22:53:56.407890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '786e5dbf-c75c-4eda-a2f6-ecfab5041eff'} Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff could not be found. Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:53:56.409215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff could not be found. Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff could not be found. Aug 29 22:53:56.410791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:53:56.411898 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Returning 404 to user: Instance 786e5dbf-c75c-4eda-a2f6-ecfab5041eff could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:53:56.411898 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ce8ea4e0-20dd-4607-b2f5-77ab0830f0de tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff" status: 404 len: 111 microversion: 2.1 time: 0.046383 Aug 29 22:53:56.411898 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 360/738] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:56 2022] GET /compute/v2.1/servers/786e5dbf-c75c-4eda-a2f6-ecfab5041eff => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:53:56.419419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.419926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.428317 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.435839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.435839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.435839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.435839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.436259 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.462945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:53:56.610261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:56.619411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9cd9fe1c-351b-4d69-a417-9f94fc5b29ee tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.336854 Aug 29 22:53:56.620742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 379/739] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:56 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:56.912761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-802ef2b3-5356-40aa-bf7a-bcdde737af0a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "DELETE /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 204 len: 0 microversion: 2.1 time: 0.506483 Aug 29 22:53:56.914640 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 361/740] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:53:56 2022] DELETE /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:53:56.922727 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:56.923317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:56.930042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.930686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.931118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:56.931811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:56.932257 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:56.932669 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.136833 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:57.150643 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-532ebf6f-eb98-4938-a593-70a34d7fb5e6 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.231532 Aug 29 22:53:57.152290 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 380/741] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:56 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:57.408034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:57.411450 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:57.423922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.424559 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.426885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.428105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.428851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.429405 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.470654 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lazy-loading 'flavor' on Instance uuid 4382fa7b-f19c-4e64-bcb4-28994556231c {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:53:57.644188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:57.645519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:57.652026 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.652912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.653552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.654417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:57.655173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:57.655985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:57.661655 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:53:57.880175 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:57.889442 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a665c3f2-417a-4f4d-9259-90098f30bff3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.249632 Aug 29 22:53:57.890393 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 381/742] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:57 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:58.065076 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1f55ce74-3703-4a32-b938-3c95431be28d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/action" status: 202 len: 0 microversion: 2.20 time: 0.681015 Aug 29 22:53:58.066995 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 362/743] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Aug 29 22:53:57 2022] POST /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:53:58.074737 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:58.075355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:58.083404 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.084206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.084655 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.085474 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.086095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.086933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.173019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:58.173727 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:58.181211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.181858 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.182307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.183036 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.183501 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.183930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.339465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:58.351565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:58.353036 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:58.354235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-834057fb-51bf-4a47-897a-6c12b727a064 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.283789 Aug 29 22:53:58.359192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 382/744] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:53:58 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:53:58.371821 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:58.383920 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2f8126dd-898a-4293-8870-4861be58e722 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.214629 Aug 29 22:53:58.397377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 363/745] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:58 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:58.912858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:58.913389 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:58.923085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.923770 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.924470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:58.925336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:58.925785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:58.926203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.209201 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:59.226712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6f62bb73-2c65-4fb3-81da-78194e593f8c tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.318341 Aug 29 22:53:59.228900 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 383/746] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:58 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:53:59.383086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:59.384389 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:59.399656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.400157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.400597 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.401844 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.401844 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.402350 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.415603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:53:59.417373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:53:59.436567 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.437116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.440042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.440042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:53:59.440042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:53:59.442732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:53:59.635083 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:59.648815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:59.654501 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:59.656215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0123595a-9b54-4250-93bd-019b1e505760 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.282007 Aug 29 22:53:59.670634 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 364/747] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:53:59 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:53:59.730035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:53:59.739763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f7be09a1-8cfa-4343-bc42-bf7a515097e0 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.335189 Aug 29 22:53:59.739763 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 384/748] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:53:59 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:53:59.862227 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-450bf920-c8c7-4543-8e35-5ed3f0018b46 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Action: 'create', calling method: .version_select at 0x7efc5fb824c0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1374677275", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2aApBESFbFSpr+yGrg5XCVlVEAtt4S0olmqSkfAwNP7y8KeiFyzmsyy8Hep//LTC0870V9S1ECLaRa3Xofa/PRpmT5QPmCshoxPLMtUSg/FbrFC1T2vf1QOlqy3dapDg=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:53:59.879484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-450bf920-c8c7-4543-8e35-5ed3f0018b46 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Getting quotas for project e1e766828cca43808ba55f00a50c53f9. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:53:59.883508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-450bf920-c8c7-4543-8e35-5ed3f0018b46 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Getting quotas for user 5f04bf8fdc2c4451a3cb6a9929273973 and project e1e766828cca43808ba55f00a50c53f9. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:53:59.990814 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-450bf920-c8c7-4543-8e35-5ed3f0018b46 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.246121 Aug 29 22:53:59.995718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 365/749] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:53:59 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:00.251251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:00.251816 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:00.260314 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.260870 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.261306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.262016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.262467 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.262891 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.488841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:00.496826 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-74c96f81-f5af-4fd0-90f9-72d221d654f1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1318 microversion: 2.1 time: 0.249860 Aug 29 22:54:00.497402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 385/750] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:00 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:00.683738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:00.684323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:00.691726 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.692288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.692544 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.693265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.693713 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.694126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.764843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:00.765563 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:00.772905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.773481 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.773990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.774767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:00.775541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:00.775889 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:00.953372 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:00.956311 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:00.964577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:00.966056 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:00.967222 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-464cb51f-b0fd-46cf-93a0-859a5cb6ad00 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.287426 Aug 29 22:54:00.968119 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 366/751] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:00 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:00.980991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3527a15f-ab11-449e-adb5-b3aa08b7c388 tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1522 microversion: 2.1 time: 0.219970 Aug 29 22:54:00.982132 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 386/752] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:00 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:01.389437 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-f3118dd2-b80d-4f0e-9851-e41143984533 req-bd77fe5c-5528-4982-b5b2-142f06d28e83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "946259ef-7337-4d98-9db7-9746c01d05c6", "name": "network-vif-deleted", "tag": "d86c40c3-059f-442c-8987-09c2f2683ad5"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:01.399043 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f3118dd2-b80d-4f0e-9851-e41143984533 req-bd77fe5c-5528-4982-b5b2-142f06d28e83 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.399527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f3118dd2-b80d-4f0e-9851-e41143984533 req-bd77fe5c-5528-4982-b5b2-142f06d28e83 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.400044 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f3118dd2-b80d-4f0e-9851-e41143984533 req-bd77fe5c-5528-4982-b5b2-142f06d28e83 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.411048 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-f3118dd2-b80d-4f0e-9851-e41143984533 req-bd77fe5c-5528-4982-b5b2-142f06d28e83 service nova] Creating event network-vif-deleted:d86c40c3-059f-442c-8987-09c2f2683ad5 for instance 946259ef-7337-4d98-9db7-9746c01d05c6 on hv-cinder-85426 Aug 29 22:54:01.415882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-f3118dd2-b80d-4f0e-9851-e41143984533 req-bd77fe5c-5528-4982-b5b2-142f06d28e83 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030941 Aug 29 22:54:01.416837 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 367/753] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:01.520998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:01.521721 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:01.528195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.528698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.529189 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.529898 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.530361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.530755 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.687930 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:01.700264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-14dc6690-eef1-4e16-aa93-aa9ec583322f tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1506 microversion: 2.1 time: 0.183611 Aug 29 22:54:01.701664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 387/754] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:01 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:01.728642 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0e84a64e-1fa5-4f62-8497-587dfdb8ffd4", "device": "/dev/sdb"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:01.734088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:01.742457 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.743120 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.743950 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.745170 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:01.745745 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:01.746279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:01.998349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:01.999120 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:02.005885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.006603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.007183 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.008020 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.008579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.009234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.203346 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:02.212709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:02.214146 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:02.215396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-71b97955-1d95-4955-bf96-996ed44adbd3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.221150 Aug 29 22:54:02.215984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 388/755] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:01 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:02.220365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:02.220942 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:02.226594 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.227153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.227588 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.228266 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.228707 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.229142 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.261868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:02.262359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:02.262844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:02.264056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lazy-loading 'fault' on Instance uuid 946259ef-7337-4d98-9db7-9746c01d05c6 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:54:02.348637 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f9f8eb7a20431ca0d679af45946bce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52aad64da33c4a48aa9eb7e325c5669b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:02.353804 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0f64be8d-e9f4-4051-b499-f72ba7e2c86a tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 200 len: 1311 microversion: 2.1 time: 0.136849 Aug 29 22:54:02.354591 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 389/756] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:02 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 1311 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:02.554449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4bfbf753-209d-4d7e-875a-3ab5440fe4fb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "POST /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.831542 Aug 29 22:54:02.555070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 368/757] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:54:01 2022] POST /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a/os-volume_attachments => generated 194 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:03.239144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:03.240294 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:03.248350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.248879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.249313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.250002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.250444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.251044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.383659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:03.384314 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] [instance: 946259ef-7337-4d98-9db7-9746c01d05c6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:03.392588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.393384 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.394805 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.397715 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:03.397715 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:03.397715 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:03.414703 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:03.420516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] HTTP exception thrown: Instance 946259ef-7337-4d98-9db7-9746c01d05c6 could not be found. Aug 29 22:54:03.430056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:03.432171 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Request method failure captured: Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 HTTP/1.1 Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI_fx_ax7hXaVFnEIBOJPme5Yx-yHAOZEe7ob7RyetMxYxlOOq1u_Vs5fNJRAziZfgejU9-7rcscOUfjEh4uk-HAA3fex7iX8gvxmh5D1Slue9mJZCfARw4zI6mr2xg0Rf8e8bZRPhXgtGx4NduV7AOki27W8KNUFzfDUXD-wgvd10 Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:54:03.433809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/52aad64da33c4a48aa9eb7e325c5669b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 52aad64da33c4a48aa9eb7e325c5669b Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1411650489 Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 53f9f8eb7a20431ca0d679af45946bce Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1411650489-project Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 946259ef-7337-4d98-9db7-9746c01d05c6 could not be found. Aug 29 22:54:03.449676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '946259ef-7337-4d98-9db7-9746c01d05c6'} Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 946259ef-7337-4d98-9db7-9746c01d05c6 could not be found. Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:54:03.450795 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 946259ef-7337-4d98-9db7-9746c01d05c6 could not be found. Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 946259ef-7337-4d98-9db7-9746c01d05c6 could not be found. Aug 29 22:54:03.452335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:03.453593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0e4b6f41-ba12-4804-90d3-7a0959fcef4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.200106 Aug 29 22:54:03.453593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 390/758] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:03 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:03.453901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] Returning 404 to user: Instance 946259ef-7337-4d98-9db7-9746c01d05c6 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:54:03.454767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f5f3e668-9986-476a-8d64-d6b161ee9d3d tempest-ServerRescueNegativeTestJSON-1411650489 tempest-ServerRescueNegativeTestJSON-1411650489-project] 10.222.0.52 "GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6" status: 404 len: 111 microversion: 2.1 time: 0.079029 Aug 29 22:54:03.455498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 369/759] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:03 2022] GET /compute/v2.1/servers/946259ef-7337-4d98-9db7-9746c01d05c6 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:54:04.458074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:04.458719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:04.465691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.466173 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.466648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:04.467345 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:04.467799 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:04.468226 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:04.685190 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:04.697277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:04.698938 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:04.700258 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-81957686-0bf3-45f7-98e8-6a04681b83a6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.246623 Aug 29 22:54:04.700843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 391/760] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:04 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:05.726502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:05.727980 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:05.740974 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.741694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.742323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.743303 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:05.743956 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:05.744568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:05.921537 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:05.931992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:05.934468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:05.936100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-20f15d4e-500a-4b1b-a1ea-eaa37915c92e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.214345 Aug 29 22:54:05.936680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 370/761] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:05 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:06.974624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:06.974624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:06.977752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.978458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.979744 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:06.980644 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:06.982057 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:06.983683 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:07.192327 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:07.203681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:07.205184 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:07.206440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8d164bd1-6174-41d6-b0bb-cea5035fe2af tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.246986 Aug 29 22:54:07.207945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 392/762] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:06 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:08.230842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:08.231492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:08.234161 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:08.240114 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.240628 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.241092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.241791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:08.242246 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:08.242671 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:08.403772 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:08.412341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:08.413826 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:08.415167 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-77d69b38-6464-43fe-a596-1faad1967c8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.188271 Aug 29 22:54:08.415776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 371/763] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:08 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:09.438915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:09.443422 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:09.446316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.446799 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.447232 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.447922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:09.448374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:09.449017 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:09.822055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:09.830994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:09.833909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:09.838975 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f3c8803a-3287-4c25-88fa-04dedf7aaf22 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.400121 Aug 29 22:54:09.838975 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 393/764] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:09 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:10.859851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:10.860516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:10.864803 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=4 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:10.870395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.870883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.871318 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:10.872017 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:10.872465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:10.872949 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:11.015341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:11.024408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:11.025880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:11.027162 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b1b22256-486f-471c-b0d8-38b763dfe0de tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.171543 Aug 29 22:54:11.027868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 372/765] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:10 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:12.052176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:12.052806 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:12.059573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.060098 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.060521 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.061245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:12.061689 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:12.066462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:12.205251 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:12.214407 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:12.215842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:12.217018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3cf909be-429c-49ef-ae47-7c09359bafc7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.170474 Aug 29 22:54:12.217577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 394/766] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:12 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:13.241569 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:13.245451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:13.252410 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.255944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.255944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.255944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:13.255944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:13.256414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:13.275007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:13.396273 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:13.404600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:13.406238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:13.407392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1815e929-8024-40b9-9cdf-48546cc8039b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.170712 Aug 29 22:54:13.407954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 373/767] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:13 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:14.432108 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:14.432592 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:14.434695 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:14.439535 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.440018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.440451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.441890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:14.442345 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:14.442799 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:14.587145 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:14.595104 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:14.596566 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:14.598555 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-478af05a-d5ec-44cf-b5ca-f6d7b4dbfb77 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.170764 Aug 29 22:54:14.599131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 395/768] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:14 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:15.622790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:15.623400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:15.631058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.631549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.631986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.632681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:15.633159 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:15.633582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:15.774161 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:15.782250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:15.784891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:15.785690 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0cee27aa-04ff-41ff-a1bf-d351cc1e56f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.166235 Aug 29 22:54:15.790335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 374/769] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:15 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:16.807444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:16.807998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:16.814773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.815245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.815670 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.816350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:16.817337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:16.823059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:16.966714 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:16.974866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:16.976287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:16.977470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4349555d-baec-48aa-ae70-632af97a8858 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.174002 Aug 29 22:54:16.978212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 396/770] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:16 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:17.454395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:17.461120 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:17.461471 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.462214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.462640 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.463317 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:17.463763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:17.464179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:17.487298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-62d1f37f-c40a-412c-b08c-4c9caa672fa7 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/ips" status: 200 len: 144 microversion: 2.1 time: 0.036709 Aug 29 22:54:17.487863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 375/771] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:54:17 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:18.000793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:18.001423 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:18.007635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.008118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.008547 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.009754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:18.009754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:18.010110 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:18.027735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:18.193827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:18.202200 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:18.203820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:18.205098 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-25e38616-c72d-41b9-b4a5-1aedabc097a2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.208149 Aug 29 22:54:18.205649 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 397/772] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:17 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:19.230124 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:19.230738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:19.237668 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.238279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.239243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.239959 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:19.240536 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:19.240995 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:19.404296 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:19.413333 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:19.414820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:19.416002 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-66cc2125-985a-4306-b2df-a7a44399acea tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.190311 Aug 29 22:54:19.416533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 376/773] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:19 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:20.170376 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8fc5a7d5-168c-406a-9c35-b0be4a3bbb12"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:20.172854 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:20.180410 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.180931 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.181359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.182046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.182496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.182967 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.439395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:20.442440 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:20.447345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.447834 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.448276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.449007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:20.449492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:20.449913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:20.600835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:20.616911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:20.618467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:20.619727 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c9938f9e-4751-406a-b163-19916b1ecb4a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.184241 Aug 29 22:54:20.620355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 377/774] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:20 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:21.038819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a72c7688-9058-4e34-8fd1-e98af08c4eb5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872838 Aug 29 22:54:21.039354 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 398/775] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:54:20 2022] POST /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:21.644284 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:21.645320 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:21.651785 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.652260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.652690 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.653454 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:21.653902 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:21.654341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:21.790955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:21.800819 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:21.802474 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:21.803978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-42fb5205-59e4-4a9b-9a40-f093e1652e6a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1745 microversion: 2.20 time: 0.163735 Aug 29 22:54:21.805526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 378/776] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:21 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1745 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:22.830415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:22.831142 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:22.838276 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.838769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.839205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.839905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:22.840356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:22.840808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:22.997737 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:23.006468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:23.008958 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:23.010133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-407c633b-6318-404d-abc4-b4c14de1cdbc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1745 microversion: 2.20 time: 0.185155 Aug 29 22:54:23.016758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 399/777] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:22 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:23.017034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:23.017465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:23.024603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:23.025122 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:23.025647 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:23.026460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:23.026912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:23.027432 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:23.118903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lazy-loading 'services' on Instance uuid c7521284-b51c-49f4-96d5-549f7264930a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:54:23.362539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-29f76b10-f0c4-4763-99b5-b634f06b3cf3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a/os-volume_attachments/0e84a64e-1fa5-4f62-8497-587dfdb8ffd4" status: 202 len: 0 microversion: 2.1 time: 0.346640 Aug 29 22:54:23.362539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 379/778] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:54:23 2022] DELETE /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a/os-volume_attachments/0e84a64e-1fa5-4f62-8497-587dfdb8ffd4 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:54:24.035518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:24.036065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:24.041867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:24.042355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:24.042789 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:24.043485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:24.043939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:24.044419 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:24.188749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:24.197759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:24.199308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:24.200476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8179be6f-4054-4dc3-9e58-c610ae546ffa tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1745 microversion: 2.20 time: 0.170338 Aug 29 22:54:24.201058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 400/779] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:24 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:24.447651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-592168568", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1374677275", "security_groups": [{"name": "tempest-secgroup-smoke-2019514359"}], "networks": [{"uuid": "cdc689a8-02d8-417d-924a-20e87953aa8c"}], "block_device_mapping_v2": [{"uuid": "ad9a5a40-83f2-4fb2-9187-391927202079", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:24.570500 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] validate_networks() for [('cdc689a8-02d8-417d-924a-20e87953aa8c', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:54:25.047720 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:54:25.048218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:54:25.048687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:54:25.049126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:54:25.049530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:54:25.058509 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.060347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.060347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.060347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.060635 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.060973 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.077877 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Getting quotas for project e1e766828cca43808ba55f00a50c53f9. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:54:25.081757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Getting quotas for user 5f04bf8fdc2c4451a3cb6a9929273973 and project e1e766828cca43808ba55f00a50c53f9. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:54:25.150599 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:54:25.150599 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ad9a5a40-83f2-4fb2-9187-391927202079',volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:54:25.232396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:25.232396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:25.232396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.233112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.233369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.234256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:25.234752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:25.235158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:25.381768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:25.390622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:25.392059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:25.393276 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-406f9c19-3c59-4bdd-be34-7250f65a2736 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1745 microversion: 2.20 time: 0.173096 Aug 29 22:54:25.393841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 401/780] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:25 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1745 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:25.609869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ed4050a4-885a-489b-8845-a5565916212f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.167350 Aug 29 22:54:25.610533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 380/781] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:54:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1169 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:54:25.622608 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-917c8d9b-fb57-4aec-932b-8a71c9c02ac4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:25.639593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-917c8d9b-fb57-4aec-932b-8a71c9c02ac4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:25.701012 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-917c8d9b-fb57-4aec-932b-8a71c9c02ac4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:25.705493 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-917c8d9b-fb57-4aec-932b-8a71c9c02ac4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1088 microversion: 2.1 time: 0.086812 Aug 29 22:54:25.706131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 402/782] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:25 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1088 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:26.417306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:26.418586 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:26.427577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.432425 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.433077 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.433823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.434268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.434686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.638831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-4ccce24b-068f-4bd3-b950-18f18342bb17 req-67fe38a9-38d4-4412-97f4-fca2f318245f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4382fa7b-f19c-4e64-bcb4-28994556231c", "name": "network-vif-plugged", "status": "completed", "tag": "4a7754e6-246d-4310-9f9e-5d280d55294e"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:26.666224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-4ccce24b-068f-4bd3-b950-18f18342bb17 req-67fe38a9-38d4-4412-97f4-fca2f318245f service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:26.671512 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-4ccce24b-068f-4bd3-b950-18f18342bb17 req-67fe38a9-38d4-4412-97f4-fca2f318245f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:26.672186 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-4ccce24b-068f-4bd3-b950-18f18342bb17 req-67fe38a9-38d4-4412-97f4-fca2f318245f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:26.690351 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:26.696965 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-4ccce24b-068f-4bd3-b950-18f18342bb17 req-67fe38a9-38d4-4412-97f4-fca2f318245f service nova] Creating event network-vif-plugged:4a7754e6-246d-4310-9f9e-5d280d55294e for instance 4382fa7b-f19c-4e64-bcb4-28994556231c on hv-cinder-85426 Aug 29 22:54:26.702881 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:26.704794 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:26.716237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-07cf9bbd-7f50-40bb-9222-8e6851b9b377 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.303220 Aug 29 22:54:26.719095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 403/783] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:26 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:26.740901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-4ccce24b-068f-4bd3-b950-18f18342bb17 req-67fe38a9-38d4-4412-97f4-fca2f318245f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.351723 Aug 29 22:54:26.740901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 381/784] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:26.741473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4da6afc5-47b5-4e8b-86a2-dcf11f9a3c35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:26.741473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4da6afc5-47b5-4e8b-86a2-dcf11f9a3c35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:26.822553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4da6afc5-47b5-4e8b-86a2-dcf11f9a3c35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:26.830475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4da6afc5-47b5-4e8b-86a2-dcf11f9a3c35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1088 microversion: 2.1 time: 0.108288 Aug 29 22:54:26.831041 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 404/785] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:26 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1088 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:27.769932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:27.769932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:27.775505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.776285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.776991 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.777901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.780044 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.780630 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.857284 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:27.858808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:27.899575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.899575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.899575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.899575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:27.900155 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:27.900155 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:27.985461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:28.006421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-dd71f9f6-24b0-4908-bc8c-825bc0225952 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1130 microversion: 2.1 time: 0.141504 Aug 29 22:54:28.006421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 405/786] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:27 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1130 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:28.033656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:28.044757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:28.046491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:28.047839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-66d9c848-099f-44b2-b685-eff4042a354d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.294507 Aug 29 22:54:28.048565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 382/787] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:27 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:29.018834 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:29.020985 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:29.030490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.031269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.031699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.032399 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.032890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.038485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.073679 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:29.075042 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:29.086120 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.086973 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.087897 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.088845 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:29.089787 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:29.090729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:29.137963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:29.147769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-aaba9ea8-0934-4a87-86bd-9e623ad38ff5 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1186 microversion: 2.1 time: 0.135407 Aug 29 22:54:29.163303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 406/788] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:29 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1186 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:29.282163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:29.294240 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:29.296075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:29.297410 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ea095568-2f98-4d27-b1d5-a932e57524f1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.227472 Aug 29 22:54:29.298267 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 383/789] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:29 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:30.174652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.174652 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.187997 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.188669 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.189636 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.191252 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.196287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.202124 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.287918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.287918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.297200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.300200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.300977 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.303455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.304586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.307338 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.340901 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:30.355631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1d43df28-0a3e-404c-8c05-03212b7a734e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1194 microversion: 2.1 time: 0.188597 Aug 29 22:54:30.358804 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 407/790] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1194 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:30.379095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.384263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.404049 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:54:30.408919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.409456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.410077 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.411011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.411617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.412189 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.718438 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:30.735720 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:30.737608 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:30.738802 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cb9dbb1a-dc8b-4908-b0d1-6d8685bbbcf7 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.377425 Aug 29 22:54:30.740923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 408/791] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:30.759395 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.766169 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.780316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.780941 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.781432 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.782205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.782782 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.783267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.822999 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1fb4653c-0d3c-4b84-871d-b5495c396f77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080594 Aug 29 22:54:30.825541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 409/792] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:30.835402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.835918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.842911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.843454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.843892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.844590 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.845075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.845497 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.880948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5e0ec19e-585a-4d84-8929-6c9f85c8041b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/8fc5a7d5-168c-406a-9c35-b0be4a3bbb12" status: 200 len: 194 microversion: 2.1 time: 0.049181 Aug 29 22:54:30.881880 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 410/793] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/8fc5a7d5-168c-406a-9c35-b0be4a3bbb12 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:30.902040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-34848e03-69ae-46a1-a650-fb75dc4be865 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 204 len: 0 microversion: 2.1 time: 0.621030 Aug 29 22:54:30.904691 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 384/794] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:54:30 2022] DELETE /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 0 bytes in 626 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 29 22:54:30.917111 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:30.917745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:30.928953 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.929454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.935591 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:30.936887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:30.938484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:30.938616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.161761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:31.170992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8b37ccc6-ff01-4c6f-a606-8dfc91d3b5e5 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1512 microversion: 2.1 time: 0.258008 Aug 29 22:54:31.172761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 411/795] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:30 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1512 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:31.388869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:31.389575 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:31.420554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.422742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.422742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.422742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.427885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.429062 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.633479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:31.643127 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ac3bc188-c68f-465c-8792-c2c5803321f7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1272 microversion: 2.1 time: 0.258898 Aug 29 22:54:31.644380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 385/796] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:31 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:31.767533 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:31.768862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:31.779438 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.780402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.782002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:31.783188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:31.784747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:31.785800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.009127 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:32.017963 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:32.021281 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:32.022443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8fa47ce9-00b7-40b1-9909-554c77e0765e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.259872 Aug 29 22:54:32.022990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 412/797] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:31 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:32.194170 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:32.194788 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:32.201604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.203347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.203347 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.203879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.204358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.204876 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.361034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:32.371409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-867c7302-b34d-4171-9417-c6e4ef8495b1 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1512 microversion: 2.1 time: 0.181598 Aug 29 22:54:32.372131 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 386/798] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:32 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1512 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:32.683932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:32.683932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:32.683932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.683932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.685256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.686476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.687696 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.688127 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.918469 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:32.931862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b5a5190a-d088-4526-9acd-f87ffa26ceb0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1272 microversion: 2.1 time: 0.269020 Aug 29 22:54:32.946065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 413/799] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:32 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1272 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:32.966529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6bbe193-0f7a-4aa4-afbc-c0b3d340a87f"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:32.969388 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:32.977538 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.978281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.978953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:32.979911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:32.980570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:32.981237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.048583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:33.051274 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:33.061270 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.062202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.062824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.063728 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.064357 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.065008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.285236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:33.288420 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:33.296235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:33.298029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:33.303235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2aefa064-71b6-4065-9084-1e21799f0500 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.256027 Aug 29 22:54:33.303235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 414/800] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:33 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:33.398863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:33.399724 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:33.406415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.407217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.408487 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.410119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.410819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:33.411998 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:33.593782 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:33.609846 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c5f55976-ff74-479d-b01c-7f313f474aa0 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1512 microversion: 2.1 time: 0.217347 Aug 29 22:54:33.625256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 415/801] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:33 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1512 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:33.953908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:33.954672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:33.963108 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:33.963488 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.000165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.000165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.000165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.000165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.123032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:34.131197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-46bfac7e-7ac2-40f5-b5f8-15969afb3426 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.181969 Aug 29 22:54:34.131751 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 416/802] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:33 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:34.257211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-996017f2-cee6-47a8-8714-18cea4b9abd9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "POST /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.294182 Aug 29 22:54:34.267456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 387/803] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:54:32 2022] POST /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments => generated 194 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:34.299279 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-383f4f6c-3532-46dd-abad-5885e2ad0237 req-fcc49c72-18db-432f-bf7b-16c17dd03c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983a88ca-ab2c-40f2-8cc9-075c9783408b", "tag": "91df5732-ae39-46e4-8d12-2571816bc572"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:34.326040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:34.326858 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:34.346260 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-383f4f6c-3532-46dd-abad-5885e2ad0237 req-fcc49c72-18db-432f-bf7b-16c17dd03c63 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.349992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.349992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.349992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.349992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.350403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.350490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-383f4f6c-3532-46dd-abad-5885e2ad0237 req-fcc49c72-18db-432f-bf7b-16c17dd03c63 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.350490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-383f4f6c-3532-46dd-abad-5885e2ad0237 req-fcc49c72-18db-432f-bf7b-16c17dd03c63 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.362351 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.366096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:34.384403 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-383f4f6c-3532-46dd-abad-5885e2ad0237 req-fcc49c72-18db-432f-bf7b-16c17dd03c63 service nova] Creating event network-changed:91df5732-ae39-46e4-8d12-2571816bc572 for instance 983a88ca-ab2c-40f2-8cc9-075c9783408b on hv-cinder-85426 Aug 29 22:54:34.389896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-383f4f6c-3532-46dd-abad-5885e2ad0237 req-fcc49c72-18db-432f-bf7b-16c17dd03c63 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094628 Aug 29 22:54:34.390533 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 417/804] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:34.542239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:34.555379 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:34.557107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:34.558848 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-24311a1d-c004-4a34-8c47-d4976fa63246 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.237752 Aug 29 22:54:34.569185 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 388/805] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:34 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:34.634117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:34.635194 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:34.641659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.642378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.642987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.643944 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:34.644569 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:34.645024 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:34.720148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:34.738209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9dd22353-5255-4289-b163-8fe04e0ab0cc tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1470 microversion: 2.1 time: 0.108897 Aug 29 22:54:34.738787 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 418/806] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:34 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1470 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:35.151755 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:35.152496 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:35.159761 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:35.161322 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=6 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:35.165038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.165865 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.166613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.176480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.176480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.176480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.365035 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:35.374521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-231aaf37-00b1-438f-8c6c-9f76ffc56aee tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.226432 Aug 29 22:54:35.385891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 389/807] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:35 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:35.584164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:35.585678 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:35.594111 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.594604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.595036 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.595742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.596195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.596691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.761270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:35.762376 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:35.769092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.769974 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.770697 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.772341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:35.773239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:35.773948 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:35.778150 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:35.790060 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:35.791986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:35.795653 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2a053185-9c65-43af-8abf-fc2aae435749 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.214454 Aug 29 22:54:35.816767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 419/808] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:35 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:35.872610 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:35.881740 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b455f785-df80-47f8-b12a-555d1d921edb tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1470 microversion: 2.1 time: 0.124356 Aug 29 22:54:35.897973 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 390/809] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:35 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1470 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:36.398565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:36.399439 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:36.406573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.407340 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.407939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.408830 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.409443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.410154 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.467023 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-7c98e51d-69f2-4e79-8731-fa0c95faabc5 req-6e6c04e8-db87-42b4-8c14-2359faa2032b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7521284-b51c-49f4-96d5-549f7264930a", "name": "network-vif-deleted", "tag": "073b17c6-c60c-4033-bd71-9e7065aad2c0"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:36.497809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7c98e51d-69f2-4e79-8731-fa0c95faabc5 req-6e6c04e8-db87-42b4-8c14-2359faa2032b service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.497809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7c98e51d-69f2-4e79-8731-fa0c95faabc5 req-6e6c04e8-db87-42b4-8c14-2359faa2032b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.497809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7c98e51d-69f2-4e79-8731-fa0c95faabc5 req-6e6c04e8-db87-42b4-8c14-2359faa2032b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.519229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-7c98e51d-69f2-4e79-8731-fa0c95faabc5 req-6e6c04e8-db87-42b4-8c14-2359faa2032b service nova] Creating event network-vif-deleted:073b17c6-c60c-4033-bd71-9e7065aad2c0 for instance c7521284-b51c-49f4-96d5-549f7264930a on hv-cinder-85426 Aug 29 22:54:36.545543 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-7c98e51d-69f2-4e79-8731-fa0c95faabc5 req-6e6c04e8-db87-42b4-8c14-2359faa2032b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092116 Aug 29 22:54:36.547752 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 391/810] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:36.646584 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:36.660460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-154d61c9-db19-4a3b-9c81-e45c44c352d7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.265706 Aug 29 22:54:36.662160 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 420/811] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:36 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:36.824277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:36.825216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:36.832845 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.837695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.837695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.837695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.837695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.838066 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.907600 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:36.908933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:36.912465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=4 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:36.935086 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.935922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.936555 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:36.937498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:36.938166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:36.938797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.013987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.014785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.027110 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.027110 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lazy-loading 'fault' on Instance uuid c7521284-b51c-49f4-96d5-549f7264930a {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:54:37.101684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70cf6f471ff04dab9f8cbc268397928e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8c824e8723341808544a577b85d9b2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:37.109990 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b11b0976-fc44-40d7-9f3f-f43fa49243c3 tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 200 len: 1308 microversion: 2.1 time: 0.207183 Aug 29 22:54:37.110568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 421/812] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:36 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:37.290148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:37.305500 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:37.307028 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:37.308368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-37834c8b-6d41-4ad3-9956-32ce5bf3311a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.488323 Aug 29 22:54:37.308941 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 392/813] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:36 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:37.683139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:37.683747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:37.698040 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.698527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.698968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.699664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:37.700119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:37.700538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:37.834499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:37.842871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c76d867b-41ab-4195-8ba9-0c4512ef9cf0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.163830 Aug 29 22:54:37.843439 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 422/814] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:37 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:38.137777 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:38.138316 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] [instance: c7521284-b51c-49f4-96d5-549f7264930a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:38.144832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.145836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.145836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.146497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.146945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.147660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.166681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] HTTP exception thrown: Instance c7521284-b51c-49f4-96d5-549f7264930a could not be found. Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Request method failure captured: Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a HTTP/1.1 Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUMJHFEX4Cpq4v4fUueJK5BgptXbGT7uhqZ2LocW_e90nkoMfcsSVubo9RfZl5UGRWKjcmswjZd8mkpG1FFFM2ufdVheHOcw1XhupPUHjhHsDQza5zMOHNRsqIukcRQPjtqpM3z9tXvPyvuLBoqYcZZBMsz63HDVRhzhOh9dciA5otg Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: a8c824e8723341808544a577b85d9b2d Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1526487074 Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:54:38.168525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a8c824e8723341808544a577b85d9b2d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a8c824e8723341808544a577b85d9b2d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8c824e8723341808544a577b85d9b2d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a8c824e8723341808544a577b85d9b2d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-VolumesSnapshotTestJSON-1526487074 Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: a8c824e8723341808544a577b85d9b2d Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1526487074 Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-VolumesSnapshotTestJSON-1526487074-project Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 70cf6f471ff04dab9f8cbc268397928e Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-VolumesSnapshotTestJSON-1526487074-project Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance c7521284-b51c-49f4-96d5-549f7264930a could not be found. Aug 29 22:54:38.170277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'c7521284-b51c-49f4-96d5-549f7264930a'} Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7521284-b51c-49f4-96d5-549f7264930a could not be found. Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:54:38.171519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7521284-b51c-49f4-96d5-549f7264930a could not be found. Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7521284-b51c-49f4-96d5-549f7264930a could not be found. Aug 29 22:54:38.173241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:54:38.176165 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] Returning 404 to user: Instance c7521284-b51c-49f4-96d5-549f7264930a could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:54:38.177838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e20c1071-560c-48ed-ab25-b022f3baa43d tempest-VolumesSnapshotTestJSON-1526487074 tempest-VolumesSnapshotTestJSON-1526487074-project] 10.222.0.52 "GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a" status: 404 len: 111 microversion: 2.1 time: 0.044058 Aug 29 22:54:38.178659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 393/815] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:38 2022] GET /compute/v2.1/servers/c7521284-b51c-49f4-96d5-549f7264930a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:54:38.340299 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:38.345479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:38.354352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.358311 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.358311 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.369854 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.370769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.371223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.567658 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:38.579018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:38.582543 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:38.584968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7d07b071-c40a-4e97-9e07-e54c7120df24 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.256291 Aug 29 22:54:38.586017 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 423/816] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:38 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:38.863613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:38.864485 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:38.871233 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.871742 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.872251 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:38.873070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:38.873529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:38.873959 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.011512 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:39.019127 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-fb3eee78-2eca-409c-bfb8-28a8efed0dcc tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.159548 Aug 29 22:54:39.019677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 394/817] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:38 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:39.609911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:39.610576 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:39.621224 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.623068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.623068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.623068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:39.626468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:39.626468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:39.765953 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:39.774867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:39.776440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:39.777719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-554ba1e0-8ad1-48f5-adf8-3171829d91ac tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1740 microversion: 2.20 time: 0.171875 Aug 29 22:54:39.778371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 424/818] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:39 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:40.040578 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:40.041264 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:40.047715 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.048194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.048624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.049335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.049788 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.050262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.259958 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:40.267981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-fcb0bad7-8956-48b2-bd0a-56be2be12f94 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.232066 Aug 29 22:54:40.268541 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 395/819] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:40 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:40.802907 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:40.803525 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:40.810063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.810479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.810902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.811575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:40.812015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:40.812426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:40.952275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:40.960504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:40.961980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:40.963423 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-ed9ccc58-7d4e-4166-8986-d5d25437e2dd tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1722 microversion: 2.20 time: 0.165170 Aug 29 22:54:40.964019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 425/820] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:40 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:41.295343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:41.295970 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:41.298416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:41.303184 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.303660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.304096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.304807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.305264 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.305687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.438736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:41.446835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4b92ab43-846b-434f-b30a-81d6a85199be tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.155255 Aug 29 22:54:41.447526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 396/821] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:41 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:41.987401 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:41.988012 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:41.995381 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.995871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.996303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:41.997037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:41.997489 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:41.997912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.134704 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:42.142836 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:42.144263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:42.145430 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d7fde344-c2e6-4fbf-b109-d5ceb1aff726 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1722 microversion: 2.20 time: 0.161940 Aug 29 22:54:42.146055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 426/822] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:41 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:42.468567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:42.475097 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:42.476337 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.476845 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.477376 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.478005 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:42.478467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:42.478888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:42.610704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:42.619613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-209d7c77-d85d-45c6-909c-e71730f7c1eb tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.155047 Aug 29 22:54:42.620176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 397/823] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:42 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:43.168283 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:43.168821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:43.175134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.175606 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.176027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.176699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.177181 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.177621 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.314291 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:43.322793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:43.324252 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:43.325424 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-974dba37-1173-40de-ba09-42bd29127418 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1722 microversion: 2.20 time: 0.161057 Aug 29 22:54:43.325973 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 427/824] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:43 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:43.640163 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:43.640790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:43.647488 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.647969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.648403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.649134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:43.649589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:43.650014 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:43.785050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:43.795873 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-31860a48-5ef8-482c-9bd9-ec9b6af30e40 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.157810 Aug 29 22:54:43.795873 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 398/825] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:43 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:44.294668 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-1e6a5c39-197c-4a5a-9654-80553889a4a3 req-085235d4-c6fe-41d4-a8c3-fc6bfd52d7df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4382fa7b-f19c-4e64-bcb4-28994556231c", "name": "network-vif-unplugged", "status": "completed", "tag": "4a7754e6-246d-4310-9f9e-5d280d55294e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:44.306219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1e6a5c39-197c-4a5a-9654-80553889a4a3 req-085235d4-c6fe-41d4-a8c3-fc6bfd52d7df service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.307499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1e6a5c39-197c-4a5a-9654-80553889a4a3 req-085235d4-c6fe-41d4-a8c3-fc6bfd52d7df service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.307499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1e6a5c39-197c-4a5a-9654-80553889a4a3 req-085235d4-c6fe-41d4-a8c3-fc6bfd52d7df service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.327760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-1e6a5c39-197c-4a5a-9654-80553889a4a3 req-085235d4-c6fe-41d4-a8c3-fc6bfd52d7df service nova] Creating event network-vif-unplugged:4a7754e6-246d-4310-9f9e-5d280d55294e for instance 4382fa7b-f19c-4e64-bcb4-28994556231c on hv-cinder-85426 Aug 29 22:54:44.333504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-1e6a5c39-197c-4a5a-9654-80553889a4a3 req-085235d4-c6fe-41d4-a8c3-fc6bfd52d7df service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043321 Aug 29 22:54:44.334102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 428/826] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:44.349166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:44.349778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:44.357566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.358040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.358473 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.359406 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.359857 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.360274 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.503326 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:44.512433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:44.514224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:44.515360 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-00ad7412-9f8f-41e5-8a8d-fc2a62ecc2cb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1722 microversion: 2.20 time: 0.170264 Aug 29 22:54:44.516068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 399/827] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:44 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:44.816165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:44.817168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:44.824061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.824663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.825176 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.825974 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:44.826529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:44.827352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:44.963706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:44.971462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1464a18c-0d49-41e0-97b2-06721aa021e2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.159587 Aug 29 22:54:44.972033 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 429/828] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:44 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:45.092976 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-996011577"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:45.093526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:45.100244 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.117087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.117906 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.118692 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.119148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.119581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.274396 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.network.security_group_api [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Removing security group e868a67a-9153-4e52-be11-2ed8b34d6e23 from port 2e94820d-fd72-49c0-b34f-a592d817d599 Aug 29 22:54:45.541266 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:45.541975 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:45.549977 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.550689 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.551194 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.552120 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.552682 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.553228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.660869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7ac4510d-2059-4b7f-99f9-fb3cca65dac8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/action" status: 202 len: 0 microversion: 2.1 time: 0.572167 Aug 29 22:54:45.661707 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 400/829] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:54:45 2022] POST /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:54:45.675051 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-ee084501-fb11-4779-8c02-2b13588551a6 req-00f6de09-f99e-4703-974a-99116cbfda60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd65826-c1ef-45f1-ab4f-b4f011a0e44a", "tag": "2e94820d-fd72-49c0-b34f-a592d817d599"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:45.686508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-ee084501-fb11-4779-8c02-2b13588551a6 req-00f6de09-f99e-4703-974a-99116cbfda60 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.687238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-ee084501-fb11-4779-8c02-2b13588551a6 req-00f6de09-f99e-4703-974a-99116cbfda60 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.687825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-ee084501-fb11-4779-8c02-2b13588551a6 req-00f6de09-f99e-4703-974a-99116cbfda60 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.703875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-ee084501-fb11-4779-8c02-2b13588551a6 req-00f6de09-f99e-4703-974a-99116cbfda60 service nova] Creating event network-changed:2e94820d-fd72-49c0-b34f-a592d817d599 for instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a on hv-cinder-85426 Aug 29 22:54:45.709540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-ee084501-fb11-4779-8c02-2b13588551a6 req-00f6de09-f99e-4703-974a-99116cbfda60 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038025 Aug 29 22:54:45.711378 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 401/830] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:45.772573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:45.785572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:45.785572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:45.785572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8e92eeb1-b9ba-460e-80e4-71db83ab8f67 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1725 microversion: 2.20 time: 0.249064 Aug 29 22:54:45.785848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 430/831] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:45 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:45.814230 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bca61688-d012-4c55-a795-dbc5f224325b"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:45.814230 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:45.821497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.822250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.822880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.823790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:45.824559 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:45.825207 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:45.993643 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:45.994293 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:46.003737 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.004294 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.004765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.005510 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:46.006166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:46.006597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:46.230878 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:46.238659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-29a51e10-fd74-4c24-9d24-f34d519e6f2a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.249741 Aug 29 22:54:46.239134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 431/832] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:45 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:47.068909 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c24abafc-37e2-467b-9f29-e20354d2b650 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.264544 Aug 29 22:54:47.070803 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 402/833] 10.222.0.52 () {62 vars in 1364 bytes} [Mon Aug 29 22:54:45 2022] POST /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-volume_attachments => generated 188 bytes in 1267 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 29 22:54:47.214978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:47.216259 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:47.219241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=80 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:47.232799 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.233478 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.236954 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.237736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.238200 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.238635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.265201 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:47.265831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:47.277109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=100 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:47.281004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.285514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.286079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.293855 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.293855 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.293855 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.760252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:47.767988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-656f6beb-d306-436d-9835-e4f1d54337ae tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.508109 Aug 29 22:54:47.768551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 403/834] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:47 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:47.784900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:47.787219 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:47.794214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.794718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.795131 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.795832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.796286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.796707 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.814530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:47.838799 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0ee7cbdc-90d1-4662-9165-90ab338355b9 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.069152 Aug 29 22:54:47.839386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 404/835] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:47 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:47.862134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:47.862652 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:47.869640 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.870271 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.870743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.871446 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.871923 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.872369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.914207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-35dbac24-1e86-4537-981b-7c1f80c91085 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-volume_attachments/bca61688-d012-4c55-a795-dbc5f224325b" status: 202 len: 0 microversion: 2.20 time: 0.704909 Aug 29 22:54:47.915115 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 432/836] 10.222.0.52 () {60 vars in 1457 bytes} [Mon Aug 29 22:54:47 2022] DELETE /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-volume_attachments/bca61688-d012-4c55-a795-dbc5f224325b => generated 0 bytes in 706 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:54:47.919869 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-e5b99863-642c-42cd-96d6-967dbc7405bc req-77b91826-8b2b-4a45-939b-bf01685a6098 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bd65826-c1ef-45f1-ab4f-b4f011a0e44a", "tag": "2e94820d-fd72-49c0-b34f-a592d817d599"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:47.932760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-e5b99863-642c-42cd-96d6-967dbc7405bc req-77b91826-8b2b-4a45-939b-bf01685a6098 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:47.933941 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-e5b99863-642c-42cd-96d6-967dbc7405bc req-77b91826-8b2b-4a45-939b-bf01685a6098 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:47.934855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-e5b99863-642c-42cd-96d6-967dbc7405bc req-77b91826-8b2b-4a45-939b-bf01685a6098 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:47.954008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-e5b99863-642c-42cd-96d6-967dbc7405bc req-77b91826-8b2b-4a45-939b-bf01685a6098 service nova] Creating event network-changed:2e94820d-fd72-49c0-b34f-a592d817d599 for instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a on hv-cinder-85426 Aug 29 22:54:47.967309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-e5b99863-642c-42cd-96d6-967dbc7405bc req-77b91826-8b2b-4a45-939b-bf01685a6098 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050962 Aug 29 22:54:47.971686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 433/837] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:47.993426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'services' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:54:48.003879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:48.004603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.015706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.015706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.021498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.028699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.029742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.030184 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.090721 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4cc5fd21-69a1-46fc-9b86-839a49cc0a77 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/8fc5a7d5-168c-406a-9c35-b0be4a3bbb12" status: 200 len: 194 microversion: 2.1 time: 0.097278 Aug 29 22:54:48.092788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 434/838] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Aug 29 22:54:47 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/8fc5a7d5-168c-406a-9c35-b0be4a3bbb12 => generated 194 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:48.098441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:48.099019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.107581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.108067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.108499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.109219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.109667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.110086 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.181202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=139065) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 22:54:48.291368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-42ab3913-b603-4a4f-b4cc-ef2b015c3e0a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments/cfcf434b-3982-4265-854d-2db93835107d" status: 202 len: 0 microversion: 2.1 time: 0.433360 Aug 29 22:54:48.293027 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 405/839] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:54:47 2022] DELETE /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments/cfcf434b-3982-4265-854d-2db93835107d => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:54:48.300673 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:48.301584 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.311055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.311836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.313022 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.314058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.314789 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.315398 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.482009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lazy-loading 'services' on Instance uuid 5957a589-da27-4005-9715-51871f53c63c {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:54:48.537719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-aba810fe-c618-407e-bcda-d92fb42c278c tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "POST /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/action" status: 202 len: 0 microversion: 2.20 time: 0.443601 Aug 29 22:54:48.540968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 435/840] 10.222.0.52 () {62 vars in 1319 bytes} [Mon Aug 29 22:54:48 2022] POST /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/action => generated 0 bytes in 447 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:54:48.547400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:48.555244 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.563986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.564961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.565782 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.566712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.567374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.568358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.636070 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-730be4ee-aff4-4662-a96a-dfa05932f9ce tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092073 Aug 29 22:54:48.636960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 436/841] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:48 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:48.642123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:48.649668 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.660560 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.662616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.663769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.668647 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.669288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.669835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.815239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-633f572f-a4ee-4dfd-970e-3e55a0c0f075 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/8fc5a7d5-168c-406a-9c35-b0be4a3bbb12" status: 202 len: 0 microversion: 2.1 time: 0.520316 Aug 29 22:54:48.816263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 406/842] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:54:48 2022] DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/8fc5a7d5-168c-406a-9c35-b0be4a3bbb12 => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:54:48.823854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:48.825074 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:48.835850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.836887 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.837552 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.838938 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:48.839620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:48.840266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:48.964622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:48.981344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:48.985385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:48.987070 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fd869e5b-7e97-4e2c-adfa-c012c81b6b28 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1673 microversion: 2.20 time: 0.348762 Aug 29 22:54:48.989516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 437/843] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:48 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1673 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:48.996568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-dcda8c2c-ddc3-4d61-8dd4-bfa621f0c3db req-22a0b502-0065-4d5a-84ba-5119834db8b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983a88ca-ab2c-40f2-8cc9-075c9783408b", "name": "network-vif-plugged", "status": "completed", "tag": "91df5732-ae39-46e4-8d12-2571816bc572"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:49.013806 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-dcda8c2c-ddc3-4d61-8dd4-bfa621f0c3db req-22a0b502-0065-4d5a-84ba-5119834db8b5 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.015778 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-dcda8c2c-ddc3-4d61-8dd4-bfa621f0c3db req-22a0b502-0065-4d5a-84ba-5119834db8b5 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.016369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-dcda8c2c-ddc3-4d61-8dd4-bfa621f0c3db req-22a0b502-0065-4d5a-84ba-5119834db8b5 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.045287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-dcda8c2c-ddc3-4d61-8dd4-bfa621f0c3db req-22a0b502-0065-4d5a-84ba-5119834db8b5 service nova] Creating event network-vif-plugged:91df5732-ae39-46e4-8d12-2571816bc572 for instance 983a88ca-ab2c-40f2-8cc9-075c9783408b on hv-cinder-85426 Aug 29 22:54:49.056954 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-dcda8c2c-ddc3-4d61-8dd4-bfa621f0c3db req-22a0b502-0065-4d5a-84ba-5119834db8b5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063118 Aug 29 22:54:49.057598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 438/844] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:49.098747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:49.106755 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d6eb3ace-899f-44bc-8524-6919b3350a7e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.288843 Aug 29 22:54:49.107323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 407/845] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:48 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:49.651426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:49.656858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:49.667227 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.670496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.670496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.670496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:49.670496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:49.671075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:49.702641 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8c987616-b83a-45ab-a053-1c4bb62e244f tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056309 Aug 29 22:54:49.704761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 439/846] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:49 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:50.022760 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:50.027183 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:50.033846 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.034359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.034790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.035479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.035927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.036341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.131049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:50.131762 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:50.141573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.146695 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.146695 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.146695 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.146695 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.147240 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.201524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:50.209892 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:50.212048 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:50.213969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-578582a4-d582-4f3b-88da-201214b82f8d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1673 microversion: 2.20 time: 0.195405 Aug 29 22:54:50.214707 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 408/847] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:50 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1673 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:50.286877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:50.295031 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2859545e-b4ab-4988-bd9c-9ea763342389 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.168402 Aug 29 22:54:50.295808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 440/848] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:50 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:50.716039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:50.718348 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:50.724533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.725054 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.725486 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.726911 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.727381 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.727775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.757267 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6dcd84e8-bf85-4e91-9b20-9c222c5e305b tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045383 Aug 29 22:54:50.757923 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 409/849] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:50 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:54:50.769161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:50.769861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:50.776639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.777150 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.777581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.778261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:50.778711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:50.779131 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:50.855694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] HTTP exception thrown: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a is not attached to volume cfcf434b-3982-4265-854d-2db93835107d Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Request method failure captured: Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments/cfcf434b-3982-4265-854d-2db93835107d HTTP/1.1 Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDULs2GvXuUwjov2HeKO4DyhMB1wO-u7Kt7fmGb8ovSOHL-iG0vAFiwaz0eYus7OJpRI7BAhsi6NNE06m39aaLx7Ynl3NkQDyB4C360WpnDF_q_7NHrUAkOfFTJCtE98DLMOc1k0FPBKtLAYJhcWkhOptDWH33E9LE85zk9A5oAAW148 Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 6468612f8d4e4172a8bcc16f0ba73e5a Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-TestMinimumBasicScenario-2070496297 Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:54:50.861269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-TestMinimumBasicScenario-2070496297 Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 6468612f8d4e4172a8bcc16f0ba73e5a Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2070496297 Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-TestMinimumBasicScenario-2070496297-project Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 8cad1ee24ee84aa18da56d1145eac98a Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-TestMinimumBasicScenario-2070496297-project Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:54:50.862718 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a is not attached to volume cfcf434b-3982-4265-854d-2db93835107d Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'server_id': '3bd65826-c1ef-45f1-ab4f-b4f011a0e44a', 'id': 'cfcf434b-3982-4265-854d-2db93835107d'} Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cfcf434b-3982-4265-854d-2db93835107d. Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:54:50.863429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a is not attached to volume cfcf434b-3982-4265-854d-2db93835107d Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a is not attached to volume cfcf434b-3982-4265-854d-2db93835107d Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:54:50.864708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Returning 404 to user: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a is not attached to volume cfcf434b-3982-4265-854d-2db93835107d {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:54:50.865866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c5e76c2e-38e6-4944-942c-1a1ddd0108bc tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments/cfcf434b-3982-4265-854d-2db93835107d" status: 404 len: 154 microversion: 2.1 time: 0.098164 Aug 29 22:54:50.865866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 441/850] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:54:50 2022] DELETE /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a/os-volume_attachments/cfcf434b-3982-4265-854d-2db93835107d => generated 154 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:54:51.238120 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:51.238727 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:51.245195 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.245681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.246117 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.246813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.247265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.247691 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.317468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:51.317987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:51.324775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.325254 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.325679 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.326363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:51.326804 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:51.327218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:51.389615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:51.398886 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:51.400326 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:51.401509 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4ab96576-973f-49d7-a14a-1cc6813cc507 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1673 microversion: 2.20 time: 0.167345 Aug 29 22:54:51.402070 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 410/851] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:51 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:51.464349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:51.472050 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b664597f-ad7b-4515-bdb8-38202e3a64c2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.158521 Aug 29 22:54:51.472613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 442/852] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:51 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:52.424549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:52.425219 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:52.434394 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.434883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.435318 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.436012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.436465 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.436969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.494037 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:52.494667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:52.501100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.501586 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.502014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.502709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:52.503159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:52.503576 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:52.578249 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:52.590452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:52.592146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:52.593239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0dd97457-bc5c-4f11-bac6-6b34a2853015 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1673 microversion: 2.20 time: 0.172642 Aug 29 22:54:52.593787 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 411/853] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:52 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:52.645128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:52.653339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-aad5c35a-8c38-4fe1-9004-4a78bd8432f9 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.164086 Aug 29 22:54:52.653899 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 443/854] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:52 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:53.617710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:53.618329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:53.624744 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.625224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.625658 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.626344 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.626790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.627212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.674580 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:53.675285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:53.691790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.691790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.691790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.691790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:53.692211 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:53.692211 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:53.784106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:53.795810 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:53.798250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:53.800342 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d8859219-6ed7-40dd-acd9-def9c306cca2 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1673 microversion: 2.20 time: 0.187347 Aug 29 22:54:53.801182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 412/855] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:53 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1673 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:53.859268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:53.867520 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2d1d0794-5b33-48fa-b9a0-38d710ce9c5a tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1260 microversion: 2.1 time: 0.196805 Aug 29 22:54:53.868082 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 444/856] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:53 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1260 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:54.824439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:54.825052 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:54.831755 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.832223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.832662 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.833362 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.833805 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.834220 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.893601 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:54.894220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:54.903380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.908275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.908967 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:54.909911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:54.911879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:54.912672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.007502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:55.019260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:55.019260 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:55.020907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-008da86e-528b-4e8b-a603-50ca43afccce tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.200952 Aug 29 22:54:55.021536 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 413/857] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:54 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:54:55.086555 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:55.095724 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6d7986d1-9bc6-4762-b879-9aa8f8f66265 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1444 microversion: 2.1 time: 0.209037 Aug 29 22:54:55.096479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 445/858] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:54 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1444 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:55.117380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.119044 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.126141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.127137 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.127811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.128749 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.129403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.130010 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.303676 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.304357 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.315180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.315672 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.316106 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.316840 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.317303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.317741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.344466 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:55.348634 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d08e80da-f959-484e-9143-2b3b7eb4cef3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/b6bbe193-0f7a-4aa4-afbc-c0b3d340a87f" status: 200 len: 194 microversion: 2.1 time: 0.048952 Aug 29 22:54:55.349596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 446/859] 10.222.0.52 () {58 vars in 1413 bytes} [Mon Aug 29 22:54:55 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/b6bbe193-0f7a-4aa4-afbc-c0b3d340a87f => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:55.358933 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:55.359101 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.359516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.365877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.366356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.366779 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.367099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c4ca1121-0e65-4dca-9720-009bc9155da7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1444 microversion: 2.1 time: 0.254542 Aug 29 22:54:55.367464 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.367902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.368046 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 414/860] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:55 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1444 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:55.369459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.373442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.374118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.380408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.381102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.381704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.382598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.383219 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.383818 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.403212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:54:55.502131 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lazy-loading 'services' on Instance uuid 5957a589-da27-4005-9715-51871f53c63c {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:54:55.777572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-08adc1c7-ef29-469b-83de-f6081c75d7e6 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "DELETE /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 204 len: 0 microversion: 2.1 time: 0.426446 Aug 29 22:54:55.778100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 447/861] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:54:55 2022] DELETE /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:54:55.787105 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:55.788460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:55.795545 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.798761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.798761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.798761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:55.798761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:55.799318 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:55.809684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-dc51b3d3-2cc9-48de-a3d2-d9a295e9cb03 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/b6bbe193-0f7a-4aa4-afbc-c0b3d340a87f" status: 202 len: 0 microversion: 2.1 time: 0.438935 Aug 29 22:54:55.809684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 415/862] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:54:55 2022] DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments/b6bbe193-0f7a-4aa4-afbc-c0b3d340a87f => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:54:56.020116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:56.046863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:56.047570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:56.054232 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-10ddd372-2db8-4edc-9c7d-e859aabcbb85 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1555 microversion: 2.1 time: 0.271428 Aug 29 22:54:56.054870 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:56.055718 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:56.057265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:56.058428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 448/863] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:55 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1555 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:54:56.058746 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:56.059586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:56.060433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:56.370717 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:56.385405 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:56.386915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:56.388181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0365b8ca-f5b4-494b-bb4d-7cad28399e83 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.346601 Aug 29 22:54:56.388834 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 416/864] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:56 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:57.078231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:57.078855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:57.085421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.085904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.086374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.088443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.088443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.088443 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.412913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:57.414244 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:57.421418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.422204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.422711 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.423622 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:57.424236 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:57.424758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:57.595732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:57.602159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:57.604545 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:57.607607 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:57.607607 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7bab5cc8-65f2-46a3-adcc-9e3121771ecc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.198992 Aug 29 22:54:57.612042 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 417/865] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:57 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:57.612255 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9c9de33c-f2ce-4f2c-8f56-b1eb6338a702 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1555 microversion: 2.1 time: 0.536076 Aug 29 22:54:57.612255 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 449/866] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:57 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1555 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:58.185614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-676aa183-f14a-425f-8fef-7a3b335824cb req-95073ab3-7cd0-4cf2-b432-b6458d1689f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983a88ca-ab2c-40f2-8cc9-075c9783408b", "tag": "91df5732-ae39-46e4-8d12-2571816bc572"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:58.212482 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-676aa183-f14a-425f-8fef-7a3b335824cb req-95073ab3-7cd0-4cf2-b432-b6458d1689f3 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.213644 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-676aa183-f14a-425f-8fef-7a3b335824cb req-95073ab3-7cd0-4cf2-b432-b6458d1689f3 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.217019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-676aa183-f14a-425f-8fef-7a3b335824cb req-95073ab3-7cd0-4cf2-b432-b6458d1689f3 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.246767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-676aa183-f14a-425f-8fef-7a3b335824cb req-95073ab3-7cd0-4cf2-b432-b6458d1689f3 service nova] Creating event network-changed:91df5732-ae39-46e4-8d12-2571816bc572 for instance 983a88ca-ab2c-40f2-8cc9-075c9783408b on hv-cinder-85426 Aug 29 22:54:58.263285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-676aa183-f14a-425f-8fef-7a3b335824cb req-95073ab3-7cd0-4cf2-b432-b6458d1689f3 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200778 Aug 29 22:54:58.266543 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 418/867] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:54:58.632192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:58.632846 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:58.633548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:58.635026 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:58.650926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.651434 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.651877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.652698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.653070 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.653496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.658635 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.662084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.662899 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.667096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:58.667096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:58.667096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:58.919355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:58.930008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:58.931994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:58.933409 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-49c06ad1-ba46-4f5f-9160-cc8d9cc4ae3a tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.305805 Aug 29 22:54:58.934237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 450/868] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:58 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:54:59.264216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-6b3c646e-e502-4357-abe2-6f17ae0df934 req-bf3c4eac-ca70-4923-9d66-1dbff3ffb3fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bd65826-c1ef-45f1-ab4f-b4f011a0e44a", "name": "network-vif-deleted", "tag": "2e94820d-fd72-49c0-b34f-a592d817d599"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:54:59.294149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-6b3c646e-e502-4357-abe2-6f17ae0df934 req-bf3c4eac-ca70-4923-9d66-1dbff3ffb3fb service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.295498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-6b3c646e-e502-4357-abe2-6f17ae0df934 req-bf3c4eac-ca70-4923-9d66-1dbff3ffb3fb service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.296159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-6b3c646e-e502-4357-abe2-6f17ae0df934 req-bf3c4eac-ca70-4923-9d66-1dbff3ffb3fb service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.296275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:54:59.300521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:54:59.307385 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-fcb56c7f-58e1-42c1-9f61-278401d15509 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1555 microversion: 2.1 time: 0.678472 Aug 29 22:54:59.309049 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 419/869] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:54:58 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1555 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:54:59.315568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:59.323472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-6b3c646e-e502-4357-abe2-6f17ae0df934 req-bf3c4eac-ca70-4923-9d66-1dbff3ffb3fb service nova] Creating event network-vif-deleted:2e94820d-fd72-49c0-b34f-a592d817d599 for instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a on hv-cinder-85426 Aug 29 22:54:59.334068 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-6b3c646e-e502-4357-abe2-6f17ae0df934 req-bf3c4eac-ca70-4923-9d66-1dbff3ffb3fb service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080133 Aug 29 22:54:59.340960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 451/870] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:54:59.347839 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:59.364329 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.365423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.365423 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.371527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.372128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.376743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.460483 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-dabdcb46-92df-4402-bfc1-b2ec526c32d3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150286 Aug 29 22:54:59.461103 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 420/871] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:59 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:54:59.654159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:59.656407 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:59.685363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.685363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.685363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.685363 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.685921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.685921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.765314 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d4e40628-e3ba-4edd-bdba-6782c8657dc2 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.116158 Aug 29 22:54:59.773599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 452/872] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:54:59 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c/os-volume_attachments => generated 25 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:54:59.873623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:59.875010 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:59.882133 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.882860 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.883506 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.885462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.886237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.886846 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.918112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:54:59.963984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:54:59.964511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:54:59.971960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.972469 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.973204 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:54:59.973950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:54:59.974642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:54:59.975551 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.205983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:00.223143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:00.225879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:00.233887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-84aefeec-ff0e-4a20-9d99-0835f41d2380 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.273546 Aug 29 22:55:00.234725 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 453/873] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:54:59 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:00.335061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:00.335666 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:00.353488 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.353488 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.354113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.354976 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.355427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.356003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.389566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ace6db24-f922-4505-bb9d-d3e35acab5c1 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 204 len: 0 microversion: 2.1 time: 0.522412 Aug 29 22:55:00.402613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 421/874] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:54:59 2022] DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:55:00.410234 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:00.415476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:00.427292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.428285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.434820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.435563 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:00.436040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:00.436498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:00.458886 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:00.470858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6778cc5c-2962-4d45-8839-ba1c7d9f50b1 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1344 microversion: 2.1 time: 0.137271 Aug 29 22:55:00.470858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 454/875] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:00 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:00.606719 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:00.616206 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9464ffa1-da74-4ff3-a75a-a054b5267914 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.211772 Aug 29 22:55:00.617072 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 422/876] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:00 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:01.267479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:01.268974 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:01.277299 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.278575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.279235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.280359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.282325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.283043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.489841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:01.495221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:01.496820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:01.501221 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:01.506501 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:01.507948 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9c7bdef2-07e4-4647-bb35-53480d063b33 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.246846 Aug 29 22:55:01.509671 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 455/877] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:01 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:01.511548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.512348 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.512972 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.518766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.519797 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.520938 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.576667 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.577539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.578196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.578806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:01.627971 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:01.639514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4a6ff434-5eee-4a35-99b4-f505fcbeb5e0 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.148206 Aug 29 22:55:01.640149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:01.640634 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 423/878] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:01 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:01.641301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:01.648775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.650274 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.651079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.652077 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:01.652873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:01.653520 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:01.852029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:01.864019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-71ff17a3-585f-4f9b-a1ea-baaaa1e646b5 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.227981 Aug 29 22:55:01.868768 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 456/879] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:01 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:02.551039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:02.552382 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:02.570368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.570926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.572710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.573594 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.574164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.574740 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.672079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:02.692452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:02.692452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.692452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.692452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.693756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.693756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.693756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.728324 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.729780 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.730583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.731461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:02.767338 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:02.779856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:02.781501 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:02.794342 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6b049474-50b4-440f-9953-e1dfe75215ab tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.263170 Aug 29 22:55:02.808230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:02.808979 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 424/880] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:02 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:55:02.816642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f8702aec-b3c4-47fa-8058-a73efd685630 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.148505 Aug 29 22:55:02.817400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 457/881] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:02 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:02.901935 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:02.902971 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:02.912707 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.913504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.914118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:02.914893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:02.915515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:02.915950 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.092928 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:03.112208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0a684ee2-034c-40fa-b71e-6bb77af4c4de tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.218064 Aug 29 22:55:03.113104 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 425/882] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:02 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:03.820182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:03.821105 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:03.827824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.828305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.828748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.833967 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.834492 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.834924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.849626 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:03.849626 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:03.869044 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.869540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.869971 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.877139 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.878623 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.881274 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.951130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:03.951615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:03.952107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:03.952490 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:04.038826 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:04.047286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8ac5022b-48d9-4dba-a301-11c57d65cc7e tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.205909 Aug 29 22:55:04.055828 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 426/883] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:03 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:04.060623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:04.081449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:04.084536 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:04.084536 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f078c252-49f6-433d-bce7-3f333b3a370e tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.269066 Aug 29 22:55:04.085697 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 458/884] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:03 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:04.144300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:04.152767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:04.164520 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.170532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.170532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.170532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:04.170532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:04.170963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:04.380618 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:04.390863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6841f302-3841-4595-af51-b5bece615564 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.255129 Aug 29 22:55:04.391502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 427/885] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:04 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:05.080477 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:05.081187 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:05.087857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.088621 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.089369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.090277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.090936 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.091449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.110102 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:05.110951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:05.123336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.123939 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.124463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.125417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.126229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.126997 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.151372 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.152286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.153234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.154668 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:05.239073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:05.254250 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-802aba9b-238c-4e6b-807e-e09bf581f5b5 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.178671 Aug 29 22:55:05.255032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 459/886] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:05 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:05.376181 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:05.386224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:05.387773 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:05.389079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e6e612e1-f20d-4ad0-a088-a12819916854 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.283051 Aug 29 22:55:05.389633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 428/887] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:05 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:55:05.414734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:05.416518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:05.424330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.431317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.431317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.431317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:05.431317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:05.431855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:05.605347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:05.615623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-cac2c549-aa97-4d82-b411-30d3dc67366b tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.205663 Aug 29 22:55:05.616534 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 460/888] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:05 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:06.276638 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:06.278221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:06.287330 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.287827 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.288262 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.289006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.289462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.289913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.335955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.336611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.337358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.337803 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:06.396891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:06.401275 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-05589ac0-2a7e-4dc7-aa25-9b898afb9987 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.129355 Aug 29 22:55:06.402031 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 429/889] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:06 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:06.412956 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:06.413852 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:06.422011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.422572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.422937 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.423627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.424072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.424481 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.570483 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:06.574248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:06.579286 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:06.580742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:06.581887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-feb2d188-e084-495a-a033-16a03876b89d tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.172813 Aug 29 22:55:06.582444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 461/890] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:06 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:06.648123 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:06.648990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:06.655917 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.656401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.657059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.658775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:06.659399 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:06.659830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:06.895708 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:06.904853 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c822827d-28a9-4bfe-95b2-84d72d123da3 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.260570 Aug 29 22:55:06.905692 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 430/891] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:06 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:07.423482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:07.424139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:07.430890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.431621 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.432064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.432797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.433252 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.433732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.467403 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.468144 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.468503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.468978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:07.519863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:07.528790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8ce235be-ab4f-409b-abc1-7ea27689ac98 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.109422 Aug 29 22:55:07.529385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 462/892] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:07 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:07.608993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:07.609591 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:07.616088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.626038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.626038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.626038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.626038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.626868 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.761326 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:07.769779 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:07.771230 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:07.772403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b1b04d2f-e454-4cd2-b585-2ee754ea6879 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.168760 Aug 29 22:55:07.773268 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 431/893] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:07 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:07.927453 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:07.928026 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:07.934426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.939558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.939558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:07.939558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:07.939558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:07.939977 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.084299 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:08.093387 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d7fe56e1-a7c6-4698-ba18-3cbd7cb150b0 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.169787 Aug 29 22:55:08.094505 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 463/894] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:07 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:08.550726 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:08.551336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:08.558147 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.558635 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.559116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.559753 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.560242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.560664 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.596430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.596963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.597400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.597986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:08.646001 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:08.655270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-afa433aa-a8f6-4863-9a60-42c2bd17dd03 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.108388 Aug 29 22:55:08.655836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 432/895] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:08 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:08.796449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:08.797162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:08.803802 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.804280 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.804764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.805454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:08.806463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:08.807047 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:08.953483 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:08.962892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:08.964914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:08.970139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-99e07c73-81e2-4a3a-a430-346e62e1d1f6 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.173543 Aug 29 22:55:08.970139 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 464/896] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:08 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:09.115308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:09.116119 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:09.123059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.124399 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.125055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.126115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.126583 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.127011 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.153430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:09.292173 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:09.299919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-dd0ec957-a0d0-4347-b912-8865c068e12d tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1670 microversion: 2.1 time: 0.188998 Aug 29 22:55:09.300605 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 433/897] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:09 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:09.676926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:09.677451 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:09.685950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.686444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.686881 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.687581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.688034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.688458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.727337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:09.728827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:09.729602 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:09.730204 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lazy-loading 'fault' on Instance uuid 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:09.775335 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cad1ee24ee84aa18da56d1145eac98a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6468612f8d4e4172a8bcc16f0ba73e5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:09.782518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c73124ca-376d-4514-821d-c7db76147276 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 200 len: 1349 microversion: 2.1 time: 0.109560 Aug 29 22:55:09.783091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 465/898] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:09 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 1349 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:55:09.995660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:09.996279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:10.003529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.003872 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.004270 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.005009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.005462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.005890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.247577 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:10.257841 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:10.259659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:10.261067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f6319711-b140-493c-89f6-5a90a5e9b3ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.270169 Aug 29 22:55:10.261706 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 434/899] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:09 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:10.321716 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:10.326317 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:10.337674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.339073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.339831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.340771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.341711 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.342373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.376342 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-8b9f67b8-c33d-4f04-b996-109cfa32a1b1 req-e9731db2-e55a-41d3-9c75-799a8f2f6d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5957a589-da27-4005-9715-51871f53c63c", "name": "network-vif-deleted", "tag": "65cd327f-714d-410a-9959-d9a32027ba22"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:10.393512 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-8b9f67b8-c33d-4f04-b996-109cfa32a1b1 req-e9731db2-e55a-41d3-9c75-799a8f2f6d1b service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.394007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-8b9f67b8-c33d-4f04-b996-109cfa32a1b1 req-e9731db2-e55a-41d3-9c75-799a8f2f6d1b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.394589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-8b9f67b8-c33d-4f04-b996-109cfa32a1b1 req-e9731db2-e55a-41d3-9c75-799a8f2f6d1b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.419345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-8b9f67b8-c33d-4f04-b996-109cfa32a1b1 req-e9731db2-e55a-41d3-9c75-799a8f2f6d1b service nova] Creating event network-vif-deleted:65cd327f-714d-410a-9959-d9a32027ba22 for instance 5957a589-da27-4005-9715-51871f53c63c on hv-cinder-85426 Aug 29 22:55:10.450294 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-8b9f67b8-c33d-4f04-b996-109cfa32a1b1 req-e9731db2-e55a-41d3-9c75-799a8f2f6d1b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078772 Aug 29 22:55:10.453393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 435/900] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:10.486021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcd83a222eb04368a409db06389f1b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd106ca51e01f439f82fd71df4dc2ed71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:10.499392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-28132113-4d96-46e9-bd3c-d88cb9016a4a tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 200 len: 1603 microversion: 2.1 time: 0.181566 Aug 29 22:55:10.499994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 466/901] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:10 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 1603 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:10.804576 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:10.805649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] [instance: 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:10.814765 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.815462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.815896 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.816796 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:10.817414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:10.817927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:10.834315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] HTTP exception thrown: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a could not be found. Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Request method failure captured: Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a HTTP/1.1 Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDULs2GvXuUwjov2HeKO4DyhMB1wO-u7Kt7fmGb8ovSOHL-iG0vAFiwaz0eYus7OJpRI7BAhsi6NNE06m39aaLx7Ynl3NkQDyB4C360WpnDF_q_7NHrUAkOfFTJCtE98DLMOc1k0FPBKtLAYJhcWkhOptDWH33E9LE85zk9A5oAAW148 Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 6468612f8d4e4172a8bcc16f0ba73e5a Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-TestMinimumBasicScenario-2070496297 Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:55:10.836480 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/6468612f8d4e4172a8bcc16f0ba73e5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-TestMinimumBasicScenario-2070496297 Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 6468612f8d4e4172a8bcc16f0ba73e5a Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2070496297 Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-TestMinimumBasicScenario-2070496297-project Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 8cad1ee24ee84aa18da56d1145eac98a Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-TestMinimumBasicScenario-2070496297-project Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a could not be found. Aug 29 22:55:10.838790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '3bd65826-c1ef-45f1-ab4f-b4f011a0e44a'} Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a could not be found. Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:10.839729 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a could not be found. Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a could not be found. Aug 29 22:55:10.841339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:10.842670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Returning 404 to user: Instance 3bd65826-c1ef-45f1-ab4f-b4f011a0e44a could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:10.843978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-73764538-8f8f-45c2-a008-419350f598a8 tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a" status: 404 len: 111 microversion: 2.1 time: 0.040226 Aug 29 22:55:10.843978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 436/902] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:10 2022] GET /compute/v2.1/servers/3bd65826-c1ef-45f1-ab4f-b4f011a0e44a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:10.852337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2e695c4e-2412-4914-b589-6dfb9bbbda7a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] Calling method '.version_select at 0x7efc5fb87700>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:10.911710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2e695c4e-2412-4914-b589-6dfb9bbbda7a tempest-TestMinimumBasicScenario-2070496297 tempest-TestMinimumBasicScenario-2070496297-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1881287952" status: 202 len: 0 microversion: 2.1 time: 0.063222 Aug 29 22:55:10.912303 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 467/903] 10.222.0.52 () {58 vars in 1272 bytes} [Mon Aug 29 22:55:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1881287952 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:55:11.284085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:11.290918 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:11.293910 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.294530 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.295175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.295942 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.297020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.297522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.525707 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:11.529712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:11.540996 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.543198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.543857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.544791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:11.545426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:11.545852 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:11.567145 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] HTTP exception thrown: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Request method failure captured: Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c HTTP/1.1 Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI6tfZt48w8aPz6LpFCI5m2fgH0G36x1__zvbrujspsgoyYEoWTML0nA9sNfqHF0dykequfwzsrmwmzHlhfmTLJAemlsx3P1C8BE-M3u10kyeAzTGwmEkfNjV_9aDmTHGpq_Qp8OEhCAKI3UbxQ39D7juV8XcAedDnjjropNSmRVNQ Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:55:11.569735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: bcd83a222eb04368a409db06389f1b7d Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:11.571463 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '5957a589-da27-4005-9715-51871f53c63c'} Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:11.572285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:11.573554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:11.574657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Returning 404 to user: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:11.574657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-09a0e467-6e8b-4a68-9307-21f894ada47f tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 404 len: 111 microversion: 2.1 time: 0.049853 Aug 29 22:55:11.574657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 468/904] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:11 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:11.580979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b3890e35-551c-4a3d-84c0-8537e3bc94d6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '.version_select at 0x7efc5fb37700>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:11.664612 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b3890e35-551c-4a3d-84c0-8537e3bc94d6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-570855089" status: 202 len: 0 microversion: 2.1 time: 0.087595 Aug 29 22:55:11.665371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 469/905] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Aug 29 22:55:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-570855089 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:55:11.768512 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:11.778648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:11.781798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:11.782978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7cd3e70d-58aa-4cce-81fc-1fa09185f530 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.502899 Aug 29 22:55:11.796760 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 437/906] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:11 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:12.511336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-bf657156-99dd-4b3c-aa2a-656bf4c4c3b0 req-eb425b0f-e3ad-41e1-ba67-9228f22ab1b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4382fa7b-f19c-4e64-bcb4-28994556231c", "name": "network-vif-plugged", "status": "completed", "tag": "4a7754e6-246d-4310-9f9e-5d280d55294e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:12.517906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:12.523913 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bf657156-99dd-4b3c-aa2a-656bf4c4c3b0 req-eb425b0f-e3ad-41e1-ba67-9228f22ab1b6 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:12.524844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bf657156-99dd-4b3c-aa2a-656bf4c4c3b0 req-eb425b0f-e3ad-41e1-ba67-9228f22ab1b6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:12.525538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bf657156-99dd-4b3c-aa2a-656bf4c4c3b0 req-eb425b0f-e3ad-41e1-ba67-9228f22ab1b6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:12.537035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-bf657156-99dd-4b3c-aa2a-656bf4c4c3b0 req-eb425b0f-e3ad-41e1-ba67-9228f22ab1b6 service nova] Creating event network-vif-plugged:4a7754e6-246d-4310-9f9e-5d280d55294e for instance 4382fa7b-f19c-4e64-bcb4-28994556231c on hv-cinder-85426 Aug 29 22:55:12.544348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-bf657156-99dd-4b3c-aa2a-656bf4c4c3b0 req-eb425b0f-e3ad-41e1-ba67-9228f22ab1b6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038114 Aug 29 22:55:12.545267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 470/907] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:12.822933 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:12.824152 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:12.829069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:12.832573 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:12.833859 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:12.834509 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:12.835581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:12.836216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:12.836646 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:13.107035 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:13.115104 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:13.116525 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:13.117754 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3866f4a7-702b-4d67-8b06-814b785453e1 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.308111 Aug 29 22:55:13.123265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 438/908] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:12 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:14.150842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:14.150842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:14.156055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:14.156551 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:14.157197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:14.158024 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:14.158348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:14.159088 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:14.592365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:14.601347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:14.603570 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:14.604992 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-79967f52-66d1-4246-b78d-af6d0f8cb314 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.462729 Aug 29 22:55:14.605654 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 471/909] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:14 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:15.400838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:15.401499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:15.430923 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.436919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.436919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.436919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.436919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.437533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.468790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] HTTP exception thrown: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Request method failure captured: Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c HTTP/1.1 Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI6tfZt48w8aPz6LpFCI5m2fgH0G36x1__zvbrujspsgoyYEoWTML0nA9sNfqHF0dykequfwzsrmwmzHlhfmTLJAemlsx3P1C8BE-M3u10kyeAzTGwmEkfNjV_9aDmTHGpq_Qp8OEhCAKI3UbxQ39D7juV8XcAedDnjjropNSmRVNQ Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:55:15.476075 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: bcd83a222eb04368a409db06389f1b7d Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.482456 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '5957a589-da27-4005-9715-51871f53c63c'} Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:15.483325 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.484514 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.488223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Returning 404 to user: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:15.488223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-847ba772-a7ff-4bb8-91f6-3331d2197424 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 404 len: 111 microversion: 2.1 time: 0.082249 Aug 29 22:55:15.488223 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 439/910] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:55:15 2022] DELETE /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:15.494910 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:15.495519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 5957a589-da27-4005-9715-51871f53c63c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:15.506330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.508396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.508396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.509400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.510269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.510879 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.538519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] HTTP exception thrown: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Request method failure captured: Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c HTTP/1.1 Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI6tfZt48w8aPz6LpFCI5m2fgH0G36x1__zvbrujspsgoyYEoWTML0nA9sNfqHF0dykequfwzsrmwmzHlhfmTLJAemlsx3P1C8BE-M3u10kyeAzTGwmEkfNjV_9aDmTHGpq_Qp8OEhCAKI3UbxQ39D7juV8XcAedDnjjropNSmRVNQ Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:55:15.544220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: bcd83a222eb04368a409db06389f1b7d Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.545798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '5957a589-da27-4005-9715-51871f53c63c'} Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:15.546726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. Aug 29 22:55:15.548247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:15.549694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Returning 404 to user: Instance 5957a589-da27-4005-9715-51871f53c63c could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:15.549694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-080f9e8c-c594-4614-a7c8-04f4d545e021 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c" status: 404 len: 111 microversion: 2.1 time: 0.055658 Aug 29 22:55:15.549694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 472/911] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:15 2022] GET /compute/v2.1/servers/5957a589-da27-4005-9715-51871f53c63c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:15.644413 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:15.645401 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:15.669600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.671054 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.671504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.672588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:15.673100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:15.678540 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:15.856791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:15.866806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:15.869227 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:15.870400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ecdb5c16-5c98-454c-b31f-ae32f8fe5a74 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1731 microversion: 2.20 time: 0.244292 Aug 29 22:55:15.871130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 440/912] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:15 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:16.900413 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:16.903766 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:16.918415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:16.919316 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:16.920513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:16.923165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:16.924770 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:16.925437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.150592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:17.151188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:17.157812 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.158295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.158730 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.159434 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.160079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.160505 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.175320 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] HTTP exception thrown: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Request method failure captured: Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: DELETE /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 HTTP/1.1 Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI6tfZt48w8aPz6LpFCI5m2fgH0G36x1__zvbrujspsgoyYEoWTML0nA9sNfqHF0dykequfwzsrmwmzHlhfmTLJAemlsx3P1C8BE-M3u10kyeAzTGwmEkfNjV_9aDmTHGpq_Qp8OEhCAKI3UbxQ39D7juV8XcAedDnjjropNSmRVNQ Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:55:17.176946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: bcd83a222eb04368a409db06389f1b7d Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.178472 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '90821429-6373-4dcf-ac68-2af347d45eb1'} Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:17.183499 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.185012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.187885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Returning 404 to user: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:17.187885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-62be313d-29dc-4f81-83f2-c60e4a2c4c69 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 404 len: 111 microversion: 2.1 time: 0.032316 Aug 29 22:55:17.187885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 441/913] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:55:17 2022] DELETE /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:17.192666 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:17.193645 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] [instance: 90821429-6373-4dcf-ac68-2af347d45eb1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:17.205862 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.206778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.207124 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.208420 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:17.209316 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:17.209837 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:17.228693 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] HTTP exception thrown: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Request method failure captured: Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 HTTP/1.1 Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI6tfZt48w8aPz6LpFCI5m2fgH0G36x1__zvbrujspsgoyYEoWTML0nA9sNfqHF0dykequfwzsrmwmzHlhfmTLJAemlsx3P1C8BE-M3u10kyeAzTGwmEkfNjV_9aDmTHGpq_Qp8OEhCAKI3UbxQ39D7juV8XcAedDnjjropNSmRVNQ Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:55:17.230636 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/d106ca51e01f439f82fd71df4dc2ed71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: d106ca51e01f439f82fd71df4dc2ed71 Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeTestJSON-514166812 Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: bcd83a222eb04368a409db06389f1b7d Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeTestJSON-514166812-project Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.232069 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '90821429-6373-4dcf-ac68-2af347d45eb1'} Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:17.236907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. Aug 29 22:55:17.238313 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:17.239369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] Returning 404 to user: Instance 90821429-6373-4dcf-ac68-2af347d45eb1 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:17.239369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-00256107-7f2c-412e-bd71-3d73723c1bd6 tempest-AttachVolumeTestJSON-514166812 tempest-AttachVolumeTestJSON-514166812-project] 10.222.0.52 "GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1" status: 404 len: 111 microversion: 2.1 time: 0.045134 Aug 29 22:55:17.239369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 442/914] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:17 2022] GET /compute/v2.1/servers/90821429-6373-4dcf-ac68-2af347d45eb1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:55:17.269619 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:17.279659 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:17.281770 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:17.283648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-51ae0732-3480-4dcc-8610-661f72e11e4f tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1718 microversion: 2.20 time: 0.391648 Aug 29 22:55:17.284514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 473/915] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:16 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1718 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:32.672851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=9 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:32.673710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=36 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:32.984649 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a12d5794-ad84-46e1-b12c-e130387fca83 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Action: 'create', calling method: .version_select at 0x7efc5fa70af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-766470335", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQv8YNqfqbH87RhcQ9dWU+aZUyDOjBqvpThkZWjEmpge5lNdjk/lSGWsGgThZT+nVbM5rSgaYHaLZLoTrddqVTI0KjqoHD2A09TR+r6nkS6E60D63XxPYD4CxwF8VRZ5Q=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:33.038883 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-a12d5794-ad84-46e1-b12c-e130387fca83 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for project 98941ac6692045859aa7639192603764. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:55:33.049462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-a12d5794-ad84-46e1-b12c-e130387fca83 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for user df23a24f4d5948deb641de1cefad1f69 and project 98941ac6692045859aa7639192603764. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:55:33.144985 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a12d5794-ad84-46e1-b12c-e130387fca83 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.477553 Aug 29 22:55:33.147019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 443/916] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:55:32 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:33.380935 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:33.381705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=52 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:33.478978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-28236ff6-39f4-4411-8bf2-ce121906350d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: .version_select at 0x7efc5fb23e50>, body: {"keypair": {"name": "tempest-keypair-89794724", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA633w3B6bTAaboevBnkoqEVb6m10BX3GHvKabe9b2g166qNgwF/4R/sfOM3hd012Yhr9qDUDhqBq8eSeKzH+LQbskP2Sktp7J3gcLSrI0NeYBsgMcCJmtKCSv70jeF4Ow=="}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:33.495021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-28236ff6-39f4-4411-8bf2-ce121906350d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:55:33.499767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-28236ff6-39f4-4411-8bf2-ce121906350d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:55:33.638371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-28236ff6-39f4-4411-8bf2-ce121906350d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.264946 Aug 29 22:55:33.640949 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 474/917] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:55:33 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:36.619585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-790233444", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c5a5718-95a5-4078-9ca0-1c8c805a3f99"}], "security_groups": [{"name": "tempest-securitygroup--1793930465"}], "key_name": "tempest-keypair-89794724", "user_data": "}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:36.755403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] validate_networks() for [('3c5a5718-95a5-4078-9ca0-1c8c805a3f99', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:55:37.278913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:55:37.278913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:55:37.278913 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:55:37.279648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:55:37.281086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:55:37.297979 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:37.301705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:37.301705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:37.301705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:37.301705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:37.304238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:37.330346 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:55:37.334451 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:55:37.350331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:55:37.353592 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:55:37.465384 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4f833de2-a4fd-4b35-b5e9-00f32390e095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.851240 Aug 29 22:55:37.479670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 444/918] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:55:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:55:37.481175 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-bc564c32-20df-428d-a109-fd75834b8e1f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:37.483297 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-bc564c32-20df-428d-a109-fd75834b8e1f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:37.567935 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-bc564c32-20df-428d-a109-fd75834b8e1f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:37.577364 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-bc564c32-20df-428d-a109-fd75834b8e1f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1239 microversion: 2.1 time: 0.104024 Aug 29 22:55:37.579524 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 475/919] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:37 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1239 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:38.603073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d47884a4-0e3c-4a89-86ed-de9fb0bba400 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:38.605709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d47884a4-0e3c-4a89-86ed-de9fb0bba400 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:38.676542 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d47884a4-0e3c-4a89-86ed-de9fb0bba400 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:38.684610 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d47884a4-0e3c-4a89-86ed-de9fb0bba400 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1239 microversion: 2.1 time: 0.086690 Aug 29 22:55:38.685428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 445/920] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:38 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1239 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:39.706490 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:39.707107 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:39.715909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:39.716545 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:39.716891 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:39.717597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:39.718076 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:39.718501 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:39.782915 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:39.792906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f08ef11d-1219-43e0-8d8a-9bdf8d51b7c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1291 microversion: 2.1 time: 0.089100 Aug 29 22:55:39.792906 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 476/921] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:39 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1291 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:40.815637 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:40.816297 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:40.824007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:40.824498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:40.824962 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:40.825675 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:40.826130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:40.826552 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:41.032143 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:41.042315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-48b516b3-0faa-45e2-8fa8-0168e0ac2c9e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1365 microversion: 2.1 time: 0.230628 Aug 29 22:55:41.045944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 446/922] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:40 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1365 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:41.722133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-352cf9b3-b33b-4364-a4e2-2280a1c9f76e req-3f9f19f6-edbf-4fde-807d-6f5362ea5759 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c81fe3-5287-4f9b-8889-2286e532ad68", "tag": "e012ab5d-526a-49b1-9047-fa65495d9acc"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:41.732627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-352cf9b3-b33b-4364-a4e2-2280a1c9f76e req-3f9f19f6-edbf-4fde-807d-6f5362ea5759 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:41.733143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-352cf9b3-b33b-4364-a4e2-2280a1c9f76e req-3f9f19f6-edbf-4fde-807d-6f5362ea5759 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:41.733568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-352cf9b3-b33b-4364-a4e2-2280a1c9f76e req-3f9f19f6-edbf-4fde-807d-6f5362ea5759 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:41.745212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-352cf9b3-b33b-4364-a4e2-2280a1c9f76e req-3f9f19f6-edbf-4fde-807d-6f5362ea5759 service nova] Creating event network-changed:e012ab5d-526a-49b1-9047-fa65495d9acc for instance 90c81fe3-5287-4f9b-8889-2286e532ad68 on hv-cinder-85426 Aug 29 22:55:41.750250 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-352cf9b3-b33b-4364-a4e2-2280a1c9f76e req-3f9f19f6-edbf-4fde-807d-6f5362ea5759 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032005 Aug 29 22:55:41.751003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 477/923] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:42.071945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:42.072685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:42.079855 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:42.080696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:42.081377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:42.082092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:42.082749 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:42.083172 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:42.300837 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:42.310253 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2b699ecb-8d22-4724-b46a-6d9a5a73092f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1365 microversion: 2.1 time: 0.242528 Aug 29 22:55:42.310833 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 447/924] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:42 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:43.332938 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:43.333631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:43.341073 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:43.341614 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:43.342171 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:43.342994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:43.343610 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:43.344183 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:43.480620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:43.490380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b7aec954-d404-4c62-b884-402a8d404927 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1365 microversion: 2.1 time: 0.161949 Aug 29 22:55:43.491188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 478/925] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:43 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:44.513469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:44.514079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:44.520352 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:44.520871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:44.521312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:44.522014 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:44.522534 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:44.522965 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:44.666995 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:44.674551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-721869a8-3ef7-4bd1-a1b9-22c65d7c0953 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1365 microversion: 2.1 time: 0.164869 Aug 29 22:55:44.677849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 448/926] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:44 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:45.695812 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:45.696576 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:45.703429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:45.703911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:45.704339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:45.705049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:45.705494 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:45.705907 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:45.839486 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:45.847235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9d8c457e-1fd9-482f-9436-65da1c71ac1c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1365 microversion: 2.1 time: 0.155754 Aug 29 22:55:45.847798 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 479/927] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:45 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:46.705199 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-ab568aea-5f13-4280-b2be-3efd00639e1a req-5c8f2422-7664-4447-83d9-acdd6382bb7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c81fe3-5287-4f9b-8889-2286e532ad68", "name": "network-vif-plugged", "status": "completed", "tag": "e012ab5d-526a-49b1-9047-fa65495d9acc"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:46.724413 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-ab568aea-5f13-4280-b2be-3efd00639e1a req-5c8f2422-7664-4447-83d9-acdd6382bb7f service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:46.724413 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-ab568aea-5f13-4280-b2be-3efd00639e1a req-5c8f2422-7664-4447-83d9-acdd6382bb7f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:46.724413 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-ab568aea-5f13-4280-b2be-3efd00639e1a req-5c8f2422-7664-4447-83d9-acdd6382bb7f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:46.735943 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-ab568aea-5f13-4280-b2be-3efd00639e1a req-5c8f2422-7664-4447-83d9-acdd6382bb7f service nova] Creating event network-vif-plugged:e012ab5d-526a-49b1-9047-fa65495d9acc for instance 90c81fe3-5287-4f9b-8889-2286e532ad68 on hv-cinder-85426 Aug 29 22:55:46.741582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-ab568aea-5f13-4280-b2be-3efd00639e1a req-5c8f2422-7664-4447-83d9-acdd6382bb7f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039908 Aug 29 22:55:46.742656 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 449/928] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:46.869392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:46.870319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:46.876804 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:46.877282 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:46.877720 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:46.878385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:46.878827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:46.879239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:47.021257 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:47.029067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3e41eead-8105-435c-9a8e-01390c40bb4f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1365 microversion: 2.1 time: 0.164217 Aug 29 22:55:47.029639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 480/929] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:46 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:48.048393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:48.053211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:48.102674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:48.102674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:48.102674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:48.102674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:48.104013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:48.104013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:48.104013 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:48.197353 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:48.205116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-473c5d25-3ae8-46e3-9d3d-7b15c70fd95b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1365 microversion: 2.1 time: 0.157587 Aug 29 22:55:48.205686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 450/930] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:48 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:49.226909 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:49.227613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:49.229589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:49.234811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:49.242377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:49.242377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:49.242377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:49.242377 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:49.242748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:49.370007 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:49.377559 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0c88390f-1bf9-4a77-97ca-a23d8d06c99c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1555 microversion: 2.1 time: 0.154531 Aug 29 22:55:49.378112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 481/931] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:49 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:49.398286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:49.398857 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:49.401192 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=12 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:55:49.406430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:49.408556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:49.408556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:49.408556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:49.408556 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:49.408938 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:49.488806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-efbad8c8-e2f0-4a23-92c0-193b61d583bc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092376 Aug 29 22:55:49.488806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 451/932] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:55:49 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:50.504957 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-7d93e820-ea0d-4f73-a48c-09dded0b1faf req-78beae94-68ed-4321-9bab-ee67ac59ea26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90c81fe3-5287-4f9b-8889-2286e532ad68", "tag": "e012ab5d-526a-49b1-9047-fa65495d9acc"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:50.515921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-7d93e820-ea0d-4f73-a48c-09dded0b1faf req-78beae94-68ed-4321-9bab-ee67ac59ea26 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:50.516393 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-7d93e820-ea0d-4f73-a48c-09dded0b1faf req-78beae94-68ed-4321-9bab-ee67ac59ea26 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:50.516855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-7d93e820-ea0d-4f73-a48c-09dded0b1faf req-78beae94-68ed-4321-9bab-ee67ac59ea26 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:50.535007 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-7d93e820-ea0d-4f73-a48c-09dded0b1faf req-78beae94-68ed-4321-9bab-ee67ac59ea26 service nova] Creating event network-changed:e012ab5d-526a-49b1-9047-fa65495d9acc for instance 90c81fe3-5287-4f9b-8889-2286e532ad68 on hv-cinder-85426 Aug 29 22:55:50.540572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-7d93e820-ea0d-4f73-a48c-09dded0b1faf req-78beae94-68ed-4321-9bab-ee67ac59ea26 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039119 Aug 29 22:55:50.541877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 482/933] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:50.596043 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:50.598292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:50.604632 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:50.605152 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:50.605650 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:50.606364 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:50.606819 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:50.607244 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:50.639339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-8d0f90db-edd0-41b0-a2bc-6bdf880131d5 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048071 Aug 29 22:55:50.640101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 452/934] 10.222.0.52 () {60 vars in 1343 bytes} [Mon Aug 29 22:55:50 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:50.707237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:50.707725 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:50.714923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:50.715401 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:50.715828 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:50.716701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:50.717328 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:50.717933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:50.744515 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:55:51.080041 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b853e197-4084-42f3-b264-b343fdad8300 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 204 len: 0 microversion: 2.20 time: 0.376749 Aug 29 22:55:51.083868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 483/935] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Aug 29 22:55:50 2022] DELETE /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:55:51.089960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:51.090773 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:51.097421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:51.098215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:51.098900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:51.099825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:51.100474 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:51.101198 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:51.240738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:51.249129 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:51.250582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:51.251763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a9afe16a-0b42-4433-916e-0c180a73e8ad tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.166357 Aug 29 22:55:51.252321 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 453/936] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:51 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:52.275305 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:52.275755 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:52.283074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.283543 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.283962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.284640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:52.285113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:52.285524 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:52.419841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:52.428041 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:52.429517 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:52.430668 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-24125edb-590f-417a-8edb-ff553c5dd3ef tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1724 microversion: 2.20 time: 0.159873 Aug 29 22:55:52.431220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 484/937] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:52 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:53.455019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:53.455639 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:53.462678 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:53.466140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:53.466140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:53.466140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:53.466140 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:53.466566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:53.688369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:53.697080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:53.699210 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:53.700843 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-63e640d8-e732-4338-98d8-17f05babd6bc tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1657 microversion: 2.20 time: 0.249849 Aug 29 22:55:53.701405 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 454/938] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:53 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1657 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 29 22:55:53.880631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-4f2bbebc-327e-45ae-a46c-270b5c26246a req-62a77f36-37ab-46c1-a5de-28539f48a2f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4382fa7b-f19c-4e64-bcb4-28994556231c", "name": "network-vif-deleted", "tag": "4a7754e6-246d-4310-9f9e-5d280d55294e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:53.891285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-4f2bbebc-327e-45ae-a46c-270b5c26246a req-62a77f36-37ab-46c1-a5de-28539f48a2f7 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:53.891875 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-4f2bbebc-327e-45ae-a46c-270b5c26246a req-62a77f36-37ab-46c1-a5de-28539f48a2f7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:53.892308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-4f2bbebc-327e-45ae-a46c-270b5c26246a req-62a77f36-37ab-46c1-a5de-28539f48a2f7 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:53.904344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-4f2bbebc-327e-45ae-a46c-270b5c26246a req-62a77f36-37ab-46c1-a5de-28539f48a2f7 service nova] Creating event network-vif-deleted:4a7754e6-246d-4310-9f9e-5d280d55294e for instance 4382fa7b-f19c-4e64-bcb4-28994556231c on hv-cinder-85426 Aug 29 22:55:53.909249 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-4f2bbebc-327e-45ae-a46c-270b5c26246a req-62a77f36-37ab-46c1-a5de-28539f48a2f7 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032439 Aug 29 22:55:53.909843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 485/939] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:55:54.313176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-753846007", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-766470335", "security_groups": [{"name": "tempest-secgroup-smoke-1435890377"}], "block_device_mapping_v2": [{"uuid": "97e33abc-a5e1-44ea-8d55-efeb02d22d61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2773dfeb-fc93-411d-adc3-1d803860c0cc"}]}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:54.435543 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] validate_networks() for [('2773dfeb-fc93-411d-adc3-1d803860c0cc', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:55:54.735168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:54.739688 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:54.747374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.748248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.748961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.749920 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.750459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.750945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.795035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.795035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.795035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.795035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lazy-loading 'fault' on Instance uuid 4382fa7b-f19c-4e64-bcb4-28994556231c {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:55:54.847452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:54.855344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:54.857284 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '38a89946e1fb4b43aed992078dba0b4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0e8b532701e43a39a0fd260e3e5d12d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:54.858715 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6e4a29f3-e944-46cf-9d1e-a742117a03eb tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 200 len: 1371 microversion: 2.20 time: 0.136577 Aug 29 22:55:54.859572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 486/940] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:54 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 1371 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 29 22:55:54.903747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:55:54.904498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:55:54.905369 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:55:54.906180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:55:54.907141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:55:54.917962 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.922040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.922040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.922040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:54.922040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:54.922397 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:54.939694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for project 98941ac6692045859aa7639192603764. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:55:54.944019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for user df23a24f4d5948deb641de1cefad1f69 and project 98941ac6692045859aa7639192603764. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:55:55.011521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:55:55.013665 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97e33abc-a5e1-44ea-8d55-efeb02d22d61',volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:55:55.415061 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4599db07-4fe3-4fde-b56b-601ffd3cfc06 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.105662 Aug 29 22:55:55.415703 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 455/941] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:55:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:55:55.426709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8b3a21de-9e04-4bca-8fa6-e1bef780ddc3 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:55.427315 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8b3a21de-9e04-4bca-8fa6-e1bef780ddc3 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:55.489864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8b3a21de-9e04-4bca-8fa6-e1bef780ddc3 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:55.498347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8b3a21de-9e04-4bca-8fa6-e1bef780ddc3 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1093 microversion: 2.1 time: 0.075533 Aug 29 22:55:55.499378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 487/942] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:55 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:55.883314 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:55.887242 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:55.890281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:55.890767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:55.891204 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:55.891921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:55.892378 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:55.892825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:55.905902 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] HTTP exception thrown: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Request method failure captured: Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c HTTP/1.1 Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI_Zd7yMP15v8NOGCIyveGFYgl6ICLvlH_3W209PNxhHxa8EuQtdVv1EtaTQhCJxKdUMHwMko4OJYzQjNLZM369wQhSgX1t4B3lcap8wd04avpN4otkfmyEwhmtDavCvjhPGoMpwwXLFyBwI3d5m8SBLLM7onSdx8ma9aNYIJVtVBs Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:55:55.907568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 38a89946e1fb4b43aed992078dba0b4f Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:55.909358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '4382fa7b-f19c-4e64-bcb4-28994556231c'} Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:55.910286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:55.912040 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:55.916459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Returning 404 to user: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:55.916459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4e673027-2cb8-4d0d-b9b0-5cc40cfebb46 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 404 len: 111 microversion: 2.20 time: 0.030167 Aug 29 22:55:55.916459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 456/943] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:55 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:55:55.918754 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8deb56e0-6bd1-4538-876d-455b8f12529b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '.version_select at 0x7efc5fb23b80>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:56.030428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8deb56e0-6bd1-4538-876d-455b8f12529b tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-460813611" status: 204 len: 0 microversion: 2.20 time: 0.116214 Aug 29 22:55:56.031164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 488/944] 10.222.0.52 () {60 vars in 1259 bytes} [Mon Aug 29 22:55:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-460813611 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 29 22:55:56.519958 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:56.520986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:56.529247 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:56.529804 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:56.530265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:56.530955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:56.531412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:56.532011 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:56.610189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:56.621033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2f503e95-e0f1-46be-8043-209fbda4169d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1143 microversion: 2.1 time: 0.104908 Aug 29 22:55:56.622245 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 457/945] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:56 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1143 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:57.647314 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:57.647974 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:57.655288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:57.655457 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:57.655827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:57.656510 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:57.657020 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:57.657440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:57.719732 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:57.727445 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c57b4566-998b-464a-b1e8-8f968b7036b5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1191 microversion: 2.1 time: 0.084044 Aug 29 22:55:57.728027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 489/946] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:57 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1191 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:58.172580 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:58.173116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:58.179681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.180261 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.180697 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:58.181415 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.181867 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.182316 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:58.196893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] HTTP exception thrown: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Request method failure captured: Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: DELETE /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c HTTP/1.1 Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI_Zd7yMP15v8NOGCIyveGFYgl6ICLvlH_3W209PNxhHxa8EuQtdVv1EtaTQhCJxKdUMHwMko4OJYzQjNLZM369wQhSgX1t4B3lcap8wd04avpN4otkfmyEwhmtDavCvjhPGoMpwwXLFyBwI3d5m8SBLLM7onSdx8ma9aNYIJVtVBs Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:55:58.199570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 38a89946e1fb4b43aed992078dba0b4f Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.201091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '4382fa7b-f19c-4e64-bcb4-28994556231c'} Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:58.201842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.203012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.204258 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Returning 404 to user: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:58.204258 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f427a690-5149-47f8-86ce-6ab2a00b22a3 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 404 len: 111 microversion: 2.20 time: 0.032353 Aug 29 22:55:58.204258 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 458/947] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Aug 29 22:55:58 2022] DELETE /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:55:58.209913 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:58.214323 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: 4382fa7b-f19c-4e64-bcb4-28994556231c] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:58.217333 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.217817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.218237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:58.218959 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.219410 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.219821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:58.233661 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] HTTP exception thrown: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Request method failure captured: Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c HTTP/1.1 Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI_Zd7yMP15v8NOGCIyveGFYgl6ICLvlH_3W209PNxhHxa8EuQtdVv1EtaTQhCJxKdUMHwMko4OJYzQjNLZM369wQhSgX1t4B3lcap8wd04avpN4otkfmyEwhmtDavCvjhPGoMpwwXLFyBwI3d5m8SBLLM7onSdx8ma9aNYIJVtVBs Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:55:58.237322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 38a89946e1fb4b43aed992078dba0b4f Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.238700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '4382fa7b-f19c-4e64-bcb4-28994556231c'} Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:58.239527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. Aug 29 22:55:58.240960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:58.242157 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Returning 404 to user: Instance 4382fa7b-f19c-4e64-bcb4-28994556231c could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:58.242157 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-41d2f44c-67f5-44f9-a853-d59a33dc7718 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c" status: 404 len: 111 microversion: 2.20 time: 0.030931 Aug 29 22:55:58.242157 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 490/948] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:58 2022] GET /compute/v2.1/servers/4382fa7b-f19c-4e64-bcb4-28994556231c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:55:58.749112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:58.749730 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:58.756023 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.756506 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.756993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:58.757914 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:58.758372 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:58.758796 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:58.977405 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:55:58.986310 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-32e8c8b1-69d8-45f6-b8fd-5487dad023ee tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1277 microversion: 2.1 time: 0.241790 Aug 29 22:55:58.986888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 459/949] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:55:58 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:55:59.532262 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:59.532845 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:59.539793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.540287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.540737 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.542106 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.542799 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.543082 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.560978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] HTTP exception thrown: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Request method failure captured: Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb HTTP/1.1 Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUI_Zd7yMP15v8NOGCIyveGFYgl6ICLvlH_3W209PNxhHxa8EuQtdVv1EtaTQhCJxKdUMHwMko4OJYzQjNLZM369wQhSgX1t4B3lcap8wd04avpN4otkfmyEwhmtDavCvjhPGoMpwwXLFyBwI3d5m8SBLLM7onSdx8ma9aNYIJVtVBs Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:55:59.562527 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 38a89946e1fb4b43aed992078dba0b4f Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.563981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'a1d449df-3756-44b7-b3a5-12ff3702f6bb'} Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:59.564710 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.566156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.567519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Returning 404 to user: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:59.567519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-995380c0-0c9c-4a43-bdc5-c26760ee2a02 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "DELETE /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 404 len: 111 microversion: 2.20 time: 0.035723 Aug 29 22:55:59.567519 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 491/950] 10.222.0.52 () {60 vars in 1280 bytes} [Mon Aug 29 22:55:59 2022] DELETE /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:55:59.574301 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:55:59.575039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] [instance: a1d449df-3756-44b7-b3a5-12ff3702f6bb] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:55:59.578483 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-bdf0c2eb-c413-448c-adce-20ba0e569573 req-c2350b5c-3618-4cf0-978a-fa5f1cf5f757 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc481bca-3e90-4125-bf1a-ba29d4218b17", "tag": "fd84b633-713d-417d-a59b-0ba0d9a4d3c4"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:55:59.584421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.584953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.594881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.594881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.594881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.594881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.595350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bdf0c2eb-c413-448c-adce-20ba0e569573 req-c2350b5c-3618-4cf0-978a-fa5f1cf5f757 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:55:59.595350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bdf0c2eb-c413-448c-adce-20ba0e569573 req-c2350b5c-3618-4cf0-978a-fa5f1cf5f757 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:55:59.595350 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bdf0c2eb-c413-448c-adce-20ba0e569573 req-c2350b5c-3618-4cf0-978a-fa5f1cf5f757 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:55:59.602946 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-bdf0c2eb-c413-448c-adce-20ba0e569573 req-c2350b5c-3618-4cf0-978a-fa5f1cf5f757 service nova] Creating event network-changed:fd84b633-713d-417d-a59b-0ba0d9a4d3c4 for instance cc481bca-3e90-4125-bf1a-ba29d4218b17 on hv-cinder-85426 Aug 29 22:55:59.608426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] HTTP exception thrown: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.623277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-bdf0c2eb-c413-448c-adce-20ba0e569573 req-c2350b5c-3618-4cf0-978a-fa5f1cf5f757 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034491 Aug 29 22:55:59.623277 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 492/951] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Request method failure captured: Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb HTTP/1.1 Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUI_Zd7yMP15v8NOGCIyveGFYgl6ICLvlH_3W209PNxhHxa8EuQtdVv1EtaTQhCJxKdUMHwMko4OJYzQjNLZM369wQhSgX1t4B3lcap8wd04avpN4otkfmyEwhmtDavCvjhPGoMpwwXLFyBwI3d5m8SBLLM7onSdx8ma9aNYIJVtVBs Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Openstack-Nova-Api-Version: 2.20 Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:55:59.624126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/a0e8b532701e43a39a0fd260e3e5d12d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: a0e8b532701e43a39a0fd260e3e5d12d Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-607891451 Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: 38a89946e1fb4b43aed992078dba0b4f Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeShelveTestJSON-607891451-project Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.625759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'a1d449df-3756-44b7-b3a5-12ff3702f6bb'} Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:55:59.627100 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. Aug 29 22:55:59.629775 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:55:59.632272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] Returning 404 to user: Instance a1d449df-3756-44b7-b3a5-12ff3702f6bb could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:55:59.632272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6cbb138e-2e11-48f9-87f9-d4772304fac0 tempest-AttachVolumeShelveTestJSON-607891451 tempest-AttachVolumeShelveTestJSON-607891451-project] 10.222.0.52 "GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb" status: 404 len: 111 microversion: 2.20 time: 0.042037 Aug 29 22:55:59.632272 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 460/952] 10.222.0.52 () {60 vars in 1277 bytes} [Mon Aug 29 22:55:59 2022] GET /compute/v2.1/servers/a1d449df-3756-44b7-b3a5-12ff3702f6bb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:56:00.009733 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:00.011049 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:00.017423 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:00.017833 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:00.018268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:00.018977 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:00.019431 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:00.019855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:00.165059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:00.173504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-47ebdede-24c0-4128-a9bb-07b82c286985 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.167855 Aug 29 22:56:00.174156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 493/953] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:00 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:01.199575 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:01.200283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:01.206903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.207578 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.208241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.209061 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:01.209588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:01.210081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:01.429035 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:01.438356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-032fe850-e737-4307-a2d4-3fd31a2ba691 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.242732 Aug 29 22:56:01.439199 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 461/954] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:01 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:02.461104 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:02.464904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:02.471441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:02.472075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:02.472504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:02.473426 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:02.474010 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:02.474427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:02.611295 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:02.620731 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2b31a4d5-0527-4dae-9798-da71c9926df8 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.163055 Aug 29 22:56:02.632128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 494/955] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:02 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:03.644688 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:03.646743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:03.649383 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=7 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:03.658476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.659448 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.663367 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.663367 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:03.663367 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:03.664379 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:03.692926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=77 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:03.911876 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:03.930791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-46470629-5205-441c-a96f-203c362c1fff tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.291042 Aug 29 22:56:03.931776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 462/956] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:03 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:04.954222 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:04.954834 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:04.957365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:04.962552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:04.964158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:04.964902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:04.965785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:04.966373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:04.966866 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:04.970054 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:05.110322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:05.117863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f2d079a5-3924-42e8-9858-fd686a399eea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.168362 Aug 29 22:56:05.121116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 495/957] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:04 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:06.140983 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:06.141685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:06.144108 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:06.144814 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=6 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:06.149625 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:06.150031 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:06.151265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:06.151900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:06.152349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:06.157410 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:06.297294 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:06.305570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f411dca0-df40-4c8e-b688-6923ed782770 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.169289 Aug 29 22:56:06.306137 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 463/958] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:06 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:07.336744 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:07.337423 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:07.339429 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:07.347195 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:07.347734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:07.348164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:07.348881 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:07.349398 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:07.349908 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:07.486150 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:07.493759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-520184f1-9dd9-487d-81ee-e1dcfd4384cd tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.165757 Aug 29 22:56:07.494922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 496/959] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:07 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:08.515996 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:08.516879 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:08.523099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:08.523588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:08.524025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:08.524745 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:08.525280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:08.525973 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:08.671309 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:08.675877 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c834ec95-0fa6-47ba-a45d-68e8a68fad99 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.163706 Aug 29 22:56:08.676448 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 464/960] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:08 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:09.699353 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:09.702883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:09.710171 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:09.710697 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:09.711166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:09.711903 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:09.712427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:09.713046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:09.849799 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:09.858263 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d474ed2f-2db0-4ea4-86c6-84fd7bda6a35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.164378 Aug 29 22:56:09.865807 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 497/961] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:09 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:10.850103 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-02837c5d-b7dc-48a1-8c00-09556ff337ac req-9915875b-2493-49a1-8f7c-d30134d2d43a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc481bca-3e90-4125-bf1a-ba29d4218b17", "name": "network-vif-plugged", "status": "completed", "tag": "fd84b633-713d-417d-a59b-0ba0d9a4d3c4"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:10.861019 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-02837c5d-b7dc-48a1-8c00-09556ff337ac req-9915875b-2493-49a1-8f7c-d30134d2d43a service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:10.861507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-02837c5d-b7dc-48a1-8c00-09556ff337ac req-9915875b-2493-49a1-8f7c-d30134d2d43a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:10.861932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-02837c5d-b7dc-48a1-8c00-09556ff337ac req-9915875b-2493-49a1-8f7c-d30134d2d43a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:10.873871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-02837c5d-b7dc-48a1-8c00-09556ff337ac req-9915875b-2493-49a1-8f7c-d30134d2d43a service nova] Creating event network-vif-plugged:fd84b633-713d-417d-a59b-0ba0d9a4d3c4 for instance cc481bca-3e90-4125-bf1a-ba29d4218b17 on hv-cinder-85426 Aug 29 22:56:10.878912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-02837c5d-b7dc-48a1-8c00-09556ff337ac req-9915875b-2493-49a1-8f7c-d30134d2d43a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032495 Aug 29 22:56:10.879622 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 465/962] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:56:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:10.882874 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:10.883448 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:10.890079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:10.890773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:10.891336 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:10.892333 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:10.892839 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:10.893436 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:11.033497 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:11.042706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b2428f98-8dfc-4bff-ba29-f4150896b7c1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.164063 Aug 29 22:56:11.043392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 498/963] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:10 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:12.064863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:12.065568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:12.071709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:12.072458 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:12.072931 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:12.073631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:12.074090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:12.074521 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:12.230228 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:12.238286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e0c09498-ac5f-4d9c-8ca3-e409cc00e370 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1265 microversion: 2.1 time: 0.178314 Aug 29 22:56:12.241006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 466/964] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:12 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:13.260368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:13.261113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:13.268005 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:13.268492 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:13.268955 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:13.269644 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:13.270095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:13.270511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:13.414571 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:13.427789 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-61f326f3-0c9c-4f72-9ed2-53d7c03f6db1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1452 microversion: 2.1 time: 0.172327 Aug 29 22:56:13.428361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 499/965] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:13 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:13.449249 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:13.449888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:13.456054 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:13.456529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:13.457000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:13.457681 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:13.458126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:13.458544 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:13.597362 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:13.606256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ece8368b-ada6-4a40-a9ea-03d316c20cd0 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1452 microversion: 2.1 time: 0.160951 Aug 29 22:56:13.606815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 467/966] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:13 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:16.139873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-1329d133-0d4d-44a6-8167-b339145e0a29 req-38282735-8cd2-47da-876a-b6338f4d67fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc481bca-3e90-4125-bf1a-ba29d4218b17", "tag": "fd84b633-713d-417d-a59b-0ba0d9a4d3c4"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:16.150949 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1329d133-0d4d-44a6-8167-b339145e0a29 req-38282735-8cd2-47da-876a-b6338f4d67fa service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:16.151465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1329d133-0d4d-44a6-8167-b339145e0a29 req-38282735-8cd2-47da-876a-b6338f4d67fa service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:16.154236 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1329d133-0d4d-44a6-8167-b339145e0a29 req-38282735-8cd2-47da-876a-b6338f4d67fa service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:16.321475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-1329d133-0d4d-44a6-8167-b339145e0a29 req-38282735-8cd2-47da-876a-b6338f4d67fa service nova] Creating event network-changed:fd84b633-713d-417d-a59b-0ba0d9a4d3c4 for instance cc481bca-3e90-4125-bf1a-ba29d4218b17 on hv-cinder-85426 Aug 29 22:56:16.327531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-1329d133-0d4d-44a6-8167-b339145e0a29 req-38282735-8cd2-47da-876a-b6338f4d67fa service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191187 Aug 29 22:56:16.328544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 500/967] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:56:26.557900 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:26.558657 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:26.560762 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=11 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:26.561481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=31 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:26.566247 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:26.566777 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:26.567216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:26.567925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:26.568380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:26.568832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:26.593014 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c63bb13d-6c34-43b2-922f-e4e170a16b58 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/ips" status: 200 len: 150 microversion: 2.1 time: 0.039440 Aug 29 22:56:26.593591 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 468/968] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:56:26 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:28.479388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "452bdfda-8651-4ce7-be39-b09acb1ab5f9"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:28.481828 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:28.483952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=11 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:28.484538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=31 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:28.489276 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:28.489790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:28.490166 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:28.490849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:28.491343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:28.491751 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:29.539013 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f8cb8e5d-1f56-467c-83df-d939b740c9f5 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.064869 Aug 29 22:56:29.539688 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 501/969] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:56:28 2022] POST /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments => generated 194 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:37.085904 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9a510fc0-bf35-4ddc-9319-399c391c5e25 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: .version_select at 0x7efc5fa2d310>, body: {"keypair": {"name": "tempest-keypair-681029915", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgtgvY6OD9RGfABumBl8K3dJepo0GI0w9B0lzhhBbr4hj6jQTp8WKTcsB+1WlukuSNH8uryzDyTo74YNarcP1zZnnxQ1R3O2Lm0PGpBmXtKSHaDRVvXEDv+T3tb81zHeQ=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:37.102168 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-9a510fc0-bf35-4ddc-9319-399c391c5e25 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:56:37.105980 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-9a510fc0-bf35-4ddc-9319-399c391c5e25 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:56:37.249981 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9a510fc0-bf35-4ddc-9319-399c391c5e25 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.168425 Aug 29 22:56:37.250507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 469/970] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:56:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:40.479495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:40.480252 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:40.485084 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2012992410", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c5a5718-95a5-4078-9ca0-1c8c805a3f99"}], "security_groups": [{"name": "tempest-securitygroup--1875714106"}], "key_name": "tempest-keypair-681029915", "user_data": "}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:40.608627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] validate_networks() for [('3c5a5718-95a5-4078-9ca0-1c8c805a3f99', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:56:41.077096 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:56:41.077516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:56:41.077983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:56:41.078396 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:56:41.078912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:56:41.088011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:41.088549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:41.089008 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:41.089729 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:41.090174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:41.090591 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:41.108734 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:56:41.112851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:56:41.124504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:56:41.126977 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:56:41.285034 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d0f1e4ca-0476-4ba4-b470-6d0696bfed35 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.806746 Aug 29 22:56:41.285961 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 502/971] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:56:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 809 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:56:41.300094 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-93a6dcf5-5dff-42b6-8095-9536258eb7e8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:41.301644 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-93a6dcf5-5dff-42b6-8095-9536258eb7e8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:41.360189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-93a6dcf5-5dff-42b6-8095-9536258eb7e8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:41.369211 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-93a6dcf5-5dff-42b6-8095-9536258eb7e8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1241 microversion: 2.1 time: 0.074847 Aug 29 22:56:41.369881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 470/972] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:41 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:42.391604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:42.392150 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:42.399157 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:42.399701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:42.400119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:42.400828 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:42.401275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:42.401692 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:42.471383 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:42.479644 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a48d8e30-c559-4f88-a486-3981ec611821 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1245 microversion: 2.1 time: 0.092356 Aug 29 22:56:42.480294 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 503/973] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:42 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:43.502813 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:43.503202 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:43.511359 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:43.511757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:43.512221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:43.513090 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:43.513548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:43.513976 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:43.583386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:43.593680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-71cf08b8-b25e-4cdc-8c6b-2b0c93060f5b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1293 microversion: 2.1 time: 0.095169 Aug 29 22:56:43.594448 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 471/974] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:43 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:44.623393 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:44.624110 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:44.630984 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:44.631475 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:44.639549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:44.639549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:44.639549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:44.639549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:44.794518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:44.803506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-519907ae-b0b9-4a8f-82e6-98f6edf33ddf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.184051 Aug 29 22:56:44.804367 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 504/975] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:44 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:45.826833 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:45.827469 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:45.833757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:45.834243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:45.834676 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:45.835449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:45.835909 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:45.837188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:45.934388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-0e3d0ee8-0486-4224-a4af-53195bb2427c req-5d48c93c-cc3b-480a-961b-a97e0f85e0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0", "tag": "2fa0d2d3-2692-42cb-8171-8661666ff0bf"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:45.944674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0e3d0ee8-0486-4224-a4af-53195bb2427c req-5d48c93c-cc3b-480a-961b-a97e0f85e0ad service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:45.945230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0e3d0ee8-0486-4224-a4af-53195bb2427c req-5d48c93c-cc3b-480a-961b-a97e0f85e0ad service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:45.946333 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-0e3d0ee8-0486-4224-a4af-53195bb2427c req-5d48c93c-cc3b-480a-961b-a97e0f85e0ad service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:45.958597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-0e3d0ee8-0486-4224-a4af-53195bb2427c req-5d48c93c-cc3b-480a-961b-a97e0f85e0ad service nova] Creating event network-changed:2fa0d2d3-2692-42cb-8171-8661666ff0bf for instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 on hv-cinder-85426 Aug 29 22:56:45.964761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-0e3d0ee8-0486-4224-a4af-53195bb2427c req-5d48c93c-cc3b-480a-961b-a97e0f85e0ad service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034618 Aug 29 22:56:45.965720 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 505/976] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:56:46.066290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:46.074368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-3176a497-baf2-4d43-b35a-eca4a3f950ba tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.251745 Aug 29 22:56:46.074945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 472/977] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:45 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:47.096694 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:47.097329 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:47.108332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:47.108332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:47.108332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:47.108332 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:47.108784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:47.108784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:47.244018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:47.252495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-495e78c1-d047-4a08-95a3-1585a4ee129f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.160481 Aug 29 22:56:47.253053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 506/978] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:47 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:48.278052 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:48.278849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:48.287278 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:48.287766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:48.288200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:48.289074 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:48.289529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:48.289988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:48.436344 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:48.447421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-83645a17-8307-4cda-8d9c-92ac6d041ca0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.175605 Aug 29 22:56:48.448136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 473/979] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:48 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:49.469563 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:49.470213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:49.477089 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:49.477572 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:49.478035 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:49.478728 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:49.479164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:49.479574 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:49.630709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:49.639125 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-ebf2e206-7c3c-4b6d-b17d-50b4b4108643 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.173301 Aug 29 22:56:49.639701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 507/980] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:49 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:50.660291 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:50.660954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:50.668264 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:50.668807 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:50.669256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:50.669958 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:50.670409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:50.670831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:50.808440 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:50.816067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-88aaf131-72c5-4dd2-9ac2-7c290b0d20eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.159824 Aug 29 22:56:50.816627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 474/981] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:50 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:51.095352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-e5e55147-79b3-4be8-9319-26ba49afd43a req-55e971a8-5943-4c9b-b2d5-bcb1561b158f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0", "name": "network-vif-plugged", "status": "completed", "tag": "2fa0d2d3-2692-42cb-8171-8661666ff0bf"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:51.100796 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:51.106078 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-e5e55147-79b3-4be8-9319-26ba49afd43a req-55e971a8-5943-4c9b-b2d5-bcb1561b158f service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:51.106544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-e5e55147-79b3-4be8-9319-26ba49afd43a req-55e971a8-5943-4c9b-b2d5-bcb1561b158f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:51.107016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-e5e55147-79b3-4be8-9319-26ba49afd43a req-55e971a8-5943-4c9b-b2d5-bcb1561b158f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:51.117847 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-e5e55147-79b3-4be8-9319-26ba49afd43a req-55e971a8-5943-4c9b-b2d5-bcb1561b158f service nova] Creating event network-vif-plugged:2fa0d2d3-2692-42cb-8171-8661666ff0bf for instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 on hv-cinder-85426 Aug 29 22:56:51.121895 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:51.123626 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-e5e55147-79b3-4be8-9319-26ba49afd43a req-55e971a8-5943-4c9b-b2d5-bcb1561b158f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032039 Aug 29 22:56:51.124202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 508/982] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:51.838052 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:51.839348 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:51.845811 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=6 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:56:51.851821 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:51.864427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:51.864427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:51.864427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:51.864427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:51.864978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:51.990373 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:51.998732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d635a3cd-8a95-4ec6-8276-528e3c6cf3ca tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.164767 Aug 29 22:56:52.000503 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 475/983] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:51 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:53.023789 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:53.026994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:53.031673 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:53.032154 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:53.032583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:53.033337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:53.033788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:53.034204 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:53.167781 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:53.175918 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b819bd76-2224-48db-a4f8-fc528010ddce tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1367 microversion: 2.1 time: 0.156741 Aug 29 22:56:53.176473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 509/984] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:53 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:54.197975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:54.198617 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:54.205674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:54.206162 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:54.206603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:54.207296 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:54.207750 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:54.208175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:54.338581 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:54.346210 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-606b6ecf-c54c-4fb9-b982-188a1e17e8b3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1557 microversion: 2.1 time: 0.152204 Aug 29 22:56:54.346774 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 476/985] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:54 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:54.366560 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:54.367084 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:54.373581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:54.374771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:54.375315 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:54.376024 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:54.376476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:54.376937 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:54.457856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2611eab5-f943-4b45-8679-486a89b4e39a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095075 Aug 29 22:56:54.458456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 510/986] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:56:54 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:55.692221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-c17e7b08-3d37-4665-9399-98ea5549d62a req-2f7a2949-0c75-43be-b4ee-2dd378d0330e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0", "tag": "2fa0d2d3-2692-42cb-8171-8661666ff0bf"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:55.702723 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c17e7b08-3d37-4665-9399-98ea5549d62a req-2f7a2949-0c75-43be-b4ee-2dd378d0330e service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:55.703193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c17e7b08-3d37-4665-9399-98ea5549d62a req-2f7a2949-0c75-43be-b4ee-2dd378d0330e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:55.703612 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-c17e7b08-3d37-4665-9399-98ea5549d62a req-2f7a2949-0c75-43be-b4ee-2dd378d0330e service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:55.714793 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-c17e7b08-3d37-4665-9399-98ea5549d62a req-2f7a2949-0c75-43be-b4ee-2dd378d0330e service nova] Creating event network-changed:2fa0d2d3-2692-42cb-8171-8661666ff0bf for instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 on hv-cinder-85426 Aug 29 22:56:55.720417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-c17e7b08-3d37-4665-9399-98ea5549d62a req-2f7a2949-0c75-43be-b4ee-2dd378d0330e service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031825 Aug 29 22:56:55.721064 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 477/987] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:56:56.265878 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:56:56.266485 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:56.273140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:56.274112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:56.274797 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:56.276158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:56.276893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:56.277597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:56.303950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lazy-loading 'flavor' on Instance uuid 983a88ca-ab2c-40f2-8cc9-075c9783408b {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:56:56.675767 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-126668ee-c192-4591-a403-e7f749953986 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "POST /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b/action" status: 202 len: 0 microversion: 2.1 time: 0.414692 Aug 29 22:56:56.676361 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 511/988] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:56:56 2022] POST /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b/action => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:56:56.686619 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:56.687334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:56.694098 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:56.695287 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:56.695719 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:56.696419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:56.696896 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:56.697320 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:56.845210 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:56.853522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-bac418fa-19f6-493f-9f64-52aebe7f1941 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.172052 Aug 29 22:56:56.854111 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 478/989] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:56 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:57.877031 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:57.877642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:57.884219 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:57.884698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:57.885168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:57.885851 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:57.886301 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:57.886719 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:58.035979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:58.043667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0074f4ca-b2e6-4f1d-82c3-080fdefc7fd1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.171458 Aug 29 22:56:58.044218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 512/990] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:57 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:56:59.065898 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:56:59.066502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:56:59.073058 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:59.077854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:59.077854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:59.077854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:56:59.077854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:56:59.078248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:56:59.217117 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:56:59.225426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-55b14e63-c77d-4a22-9aa5-37edc00e1f23 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.164001 Aug 29 22:56:59.225988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 479/991] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:56:59 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:00.247494 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:00.248084 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:00.255161 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:00.255635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:00.256058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:00.256788 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:00.257237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:00.257649 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:00.389158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:00.397032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-fff73af5-d3ca-4fe6-a1a2-ec453425ac48 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.153430 Aug 29 22:57:00.401820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 513/992] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:00 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:01.418144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:01.418671 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:01.425179 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:01.425660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:01.426094 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:01.426781 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:01.427239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:01.427663 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:01.561076 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:01.569589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-074b0742-57e7-4ff1-8b04-5db5e28d3bb8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.155376 Aug 29 22:57:01.570164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 480/993] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:01 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:02.592102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:02.592805 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:02.599117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:02.599596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:02.604738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:02.604738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:02.604738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:02.604738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:02.737222 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:02.744842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a21b42e5-54d0-43a6-b8f8-886f13420a84 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.156738 Aug 29 22:57:02.745400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 514/994] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:02 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:03.767978 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:03.768573 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:03.778523 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:03.779015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:03.779447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:03.780152 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:03.780605 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:03.781126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:03.921653 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:03.929384 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b84343e2-d6eb-4fe5-85eb-ec740519ae27 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.166247 Aug 29 22:57:03.929922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 481/995] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:03 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:04.951205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:04.951808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:04.958444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:04.958925 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:04.959358 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:04.960047 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:04.960500 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:04.961029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:05.096198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:05.103960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-14878464-5fd5-450a-98ea-5bed86df4515 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.156809 Aug 29 22:57:05.104514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 515/996] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:04 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:06.126932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:06.127473 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:06.133835 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:06.134318 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:06.134829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:06.135433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:06.135980 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:06.136294 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:06.270550 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:06.278455 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-39177e3d-851a-4ec2-b2da-734c7cb80331 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.156053 Aug 29 22:57:06.279014 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 482/997] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:06 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:07.301526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:07.302252 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:07.308765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:07.309247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:07.309681 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:07.310372 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:07.310824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:07.311243 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:07.448624 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:07.456415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-969abdab-50b2-4c62-8e2f-d9c6cc5591a1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.159976 Aug 29 22:57:07.457013 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 516/998] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:07 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:08.478500 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:08.479160 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:08.481585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:08.486319 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:08.486806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:08.487771 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:08.488477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:08.488965 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:08.489390 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:08.492055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=73 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:08.626733 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:08.635513 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0aa19e03-106d-4003-ac08-380e99fd9372 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.161137 Aug 29 22:57:08.636079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 483/999] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:08 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:09.656910 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:09.657514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:09.664598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:09.665075 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:09.665502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:09.666188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:09.666634 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:09.667098 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:09.800579 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:09.808742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c1eb0776-9e66-40e2-9bd0-f0ec6f112ad4 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.155627 Aug 29 22:57:09.809321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 517/1000] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:09 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:10.830118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:10.830731 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:10.838283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:10.838763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:10.839197 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:10.839884 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:10.840335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:10.840782 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:10.980134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:10.988182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-30f1777c-26ac-4e62-9daa-353987774629 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1570 microversion: 2.1 time: 0.162138 Aug 29 22:57:10.994315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 484/1001] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:10 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:11.009275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:11.009907 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:11.012248 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:11.016878 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:11.017439 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:11.017874 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:11.018566 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:11.019014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:11.019983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:11.022408 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:11.049198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=139065) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 29 22:57:11.374027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-af37c474-e800-4c25-9df4-717e7857f22b tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "POST /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b/action" status: 202 len: 0 microversion: 2.1 time: 0.368544 Aug 29 22:57:11.374639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 518/1002] 10.222.0.52 () {60 vars in 1278 bytes} [Mon Aug 29 22:57:11 2022] POST /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:57:11.383507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:11.384113 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:11.390034 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:11.390511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:11.390945 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:11.391634 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:11.392087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:11.392555 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:11.566074 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:11.574669 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-764156d4-60c4-4803-a6e2-e9500f63f125 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1518 microversion: 2.1 time: 0.195667 Aug 29 22:57:11.575460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 485/1003] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:11 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1518 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:12.595895 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:12.596525 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:12.603947 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:12.604428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:12.604890 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:12.605583 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:12.606027 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:12.606438 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:12.744162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:12.751983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-304895a6-9723-4845-aac4-e5196a9894c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1520 microversion: 2.1 time: 0.160330 Aug 29 22:57:12.752496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 519/1004] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:12 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:13.097847 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-1e0b9c56-0505-452f-853c-4386f9edd2da req-5acb5ee0-1f39-4d2d-a96e-b52b1a851585 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983a88ca-ab2c-40f2-8cc9-075c9783408b", "name": "network-vif-unplugged", "status": "completed", "tag": "91df5732-ae39-46e4-8d12-2571816bc572"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:13.111614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1e0b9c56-0505-452f-853c-4386f9edd2da req-5acb5ee0-1f39-4d2d-a96e-b52b1a851585 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:13.112091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1e0b9c56-0505-452f-853c-4386f9edd2da req-5acb5ee0-1f39-4d2d-a96e-b52b1a851585 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:13.112677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-1e0b9c56-0505-452f-853c-4386f9edd2da req-5acb5ee0-1f39-4d2d-a96e-b52b1a851585 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:13.124810 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.compute.server_external_events [req-1e0b9c56-0505-452f-853c-4386f9edd2da req-5acb5ee0-1f39-4d2d-a96e-b52b1a851585 service nova] Unable to find a host for instance 983a88ca-ab2c-40f2-8cc9-075c9783408b. Dropping event network-vif-unplugged {{(pid=139066) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 29 22:57:13.125685 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-1e0b9c56-0505-452f-853c-4386f9edd2da req-5acb5ee0-1f39-4d2d-a96e-b52b1a851585 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032410 Aug 29 22:57:13.126271 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 486/1005] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 29 22:57:13.773340 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:13.773932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:13.783823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:13.783823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:13.783823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:13.783823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:13.784268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:13.784268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:13.916973 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:13.924874 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-431783e9-dc59-43ef-a58d-cd7fc09190a7 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1520 microversion: 2.1 time: 0.155960 Aug 29 22:57:13.925445 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 520/1006] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:13 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:14.947516 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:14.948103 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:14.954408 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:14.954881 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:14.955316 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:14.955994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:14.956438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:14.956890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:15.142588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:15.150882 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7d653d26-6462-4141-aabd-060d760ddcb2 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.207340 Aug 29 22:57:15.151444 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 487/1007] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:14 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:16.172904 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:16.173542 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:16.180044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:16.180528 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:16.180994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:16.181684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:16.182133 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:16.182553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:16.315297 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:16.323995 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-2cb6dc01-26e1-4d96-9d01-33f928bb6665 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.154787 Aug 29 22:57:16.324585 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 521/1008] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:16 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:17.345529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:17.346082 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:17.353036 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:17.353507 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:17.353929 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:17.354608 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:17.355050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:17.355460 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:17.496258 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:17.503871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-defdc845-4547-4a08-af78-6630bb600e8f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.162516 Aug 29 22:57:17.504439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 488/1009] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:17 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:18.524843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:18.525760 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:18.531870 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:18.532348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:18.532815 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:18.533516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:18.533968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:18.534392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:18.676428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:18.685090 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-54d26ce4-b718-4ec1-830e-3988930bf5df tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.164160 Aug 29 22:57:18.685761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 522/1010] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:18 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:19.706932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:19.707539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:19.715641 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:19.716107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:19.716537 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:19.717266 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:19.717748 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:19.718173 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:19.853085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:19.861116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-007a91fd-20c9-4e00-a22b-de7e5ea9f03e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.158309 Aug 29 22:57:19.861683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 489/1011] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:19 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:20.881618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:20.882170 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:20.888509 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:20.889074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:20.889446 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:20.890122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:20.890568 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:20.890981 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:21.022390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:21.030274 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c0f040a2-e817-4fd1-a89e-5c34583e3622 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.152599 Aug 29 22:57:21.030841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 523/1012] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:20 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:22.051400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:22.052012 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:22.060267 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:22.061197 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:22.061903 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:22.062960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:22.063368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:22.064105 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:22.203476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:22.212188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d85cc951-036d-4a99-94fd-8d7df303180e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.164070 Aug 29 22:57:22.212641 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 490/1013] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:22 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:23.234030 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:23.234613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:23.241674 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:23.244022 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:23.244471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:23.245209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:23.245667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:23.246095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:23.386309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:23.394065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-479ba88d-7ada-49e0-8ee0-8bcb7308252f tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.164132 Aug 29 22:57:23.394619 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 524/1014] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:23 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:24.423249 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:24.423829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:24.430244 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.430724 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.431157 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.431856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:24.432277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:24.432696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:24.572961 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:24.581020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d38c71d0-46cd-434f-a211-7e0319c06b87 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.161641 Aug 29 22:57:24.581594 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 491/1015] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:24 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:25.226693 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-296a56fe-5cd9-424c-aae9-ac05ffe929f4 req-12b685a2-5b34-47d0-9809-be2b14f86003 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983a88ca-ab2c-40f2-8cc9-075c9783408b", "name": "network-vif-plugged", "status": "completed", "tag": "91df5732-ae39-46e4-8d12-2571816bc572"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:25.237526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-296a56fe-5cd9-424c-aae9-ac05ffe929f4 req-12b685a2-5b34-47d0-9809-be2b14f86003 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:25.238004 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-296a56fe-5cd9-424c-aae9-ac05ffe929f4 req-12b685a2-5b34-47d0-9809-be2b14f86003 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:25.238422 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-296a56fe-5cd9-424c-aae9-ac05ffe929f4 req-12b685a2-5b34-47d0-9809-be2b14f86003 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:25.249860 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-296a56fe-5cd9-424c-aae9-ac05ffe929f4 req-12b685a2-5b34-47d0-9809-be2b14f86003 service nova] Creating event network-vif-plugged:91df5732-ae39-46e4-8d12-2571816bc572 for instance 983a88ca-ab2c-40f2-8cc9-075c9783408b on hv-cinder-85426 Aug 29 22:57:25.254785 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-296a56fe-5cd9-424c-aae9-ac05ffe929f4 req-12b685a2-5b34-47d0-9809-be2b14f86003 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031768 Aug 29 22:57:25.255400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 525/1016] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:57:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:57:25.603428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:25.604323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:25.611125 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:25.611614 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:25.612112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:25.612872 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:25.613332 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:25.613783 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:25.750087 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:25.757743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-be2e4968-78ca-4e7e-b21c-f9af64c9bbe1 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1576 microversion: 2.1 time: 0.158342 Aug 29 22:57:25.758298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 492/1017] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:25 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:26.781622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:26.782337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:26.788476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.789046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.789423 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.790151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:26.790599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:26.791017 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:26.938220 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:26.950883 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6809e1e6-c4c8-4b8d-8b71-7000cfb62a35 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1563 microversion: 2.1 time: 0.174888 Aug 29 22:57:26.951761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 526/1018] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:26 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1563 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:30.589198 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:30.590511 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:30.596944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.602092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.602092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.602092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.602092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.602477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.622445 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-63801484-5c9e-450f-93ee-e001a1e01c8e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0/ips" status: 200 len: 150 microversion: 2.1 time: 0.037429 Aug 29 22:57:30.625082 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 493/1019] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:57:30 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:57:30.634402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "452bdfda-8651-4ce7-be39-b09acb1ab5f9"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:30.637555 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:30.643741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.644207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.644630 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.645371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.645819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.646230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.728015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Invalid volume: volume 452bdfda-8651-4ce7-be39-b09acb1ab5f9 is already attached to instances: 90c81fe3-5287-4f9b-8889-2286e532ad68 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: POST /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0/os-volume_attachments HTTP/1.1 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 74 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:57:30.729786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {"volumeAttachment": {"volumeId": "452bdfda-8651-4ce7-be39-b09acb1ab5f9"}} Aug 29 22:57:30.731388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Invalid volume: volume 452bdfda-8651-4ce7-be39-b09acb1ab5f9 is already attached to instances: 90c81fe3-5287-4f9b-8889-2286e532ad68 Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'server_id': '21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0', 'body': {'volumeAttachment': {'volumeId': '452bdfda-8651-4ce7-be39-b09acb1ab5f9'}}} Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 452bdfda-8651-4ce7-be39-b09acb1ab5f9 is already attached to instances: 90c81fe3-5287-4f9b-8889-2286e532ad68 Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:30.732234 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 452bdfda-8651-4ce7-be39-b09acb1ab5f9 is already attached to instances: 90c81fe3-5287-4f9b-8889-2286e532ad68 Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:30.733577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 452bdfda-8651-4ce7-be39-b09acb1ab5f9 is already attached to instances: 90c81fe3-5287-4f9b-8889-2286e532ad68 Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 400 to user: Invalid volume: volume 452bdfda-8651-4ce7-be39-b09acb1ab5f9 is already attached to instances: 90c81fe3-5287-4f9b-8889-2286e532ad68 {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8ead1233-6c6c-4155-9700-e56526cc147a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100943 Aug 29 22:57:30.734849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 527/1020] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:57:30 2022] POST /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:57:30.740217 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:30.740739 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:30.747468 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.747953 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.748390 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.749116 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:30.749570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:30.749994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:30.774964 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:57:31.091689 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f69fb12f-5553-4dd0-89db-6fbf74cea32b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 204 len: 0 microversion: 2.1 time: 0.355105 Aug 29 22:57:31.092289 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 494/1021] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:57:30 2022] DELETE /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:57:31.100352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:31.100994 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:31.110217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:31.110700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:31.111134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:31.111822 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:31.112273 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:31.112691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:31.247319 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:31.254871 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-e031db52-b512-49c2-aa68-a3fefcdb8fa7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1682 microversion: 2.1 time: 0.158341 Aug 29 22:57:31.255420 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 528/1022] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:31 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:32.278322 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:32.279107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:32.285571 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:32.286048 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:32.286479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:32.287164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:32.287613 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:32.288032 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:32.419921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:32.427701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-359ea76e-baee-4974-b4df-2dc3c7d8ca10 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1682 microversion: 2.1 time: 0.154188 Aug 29 22:57:32.428269 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 495/1023] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:32 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:33.450771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:33.451404 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:33.457926 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:33.458433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:33.458856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:33.459538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:33.459979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:33.460388 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:33.526276 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:33.540663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-75cd7327-9813-47fc-b72b-71cd4b3c5fe7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1614 microversion: 2.1 time: 0.093332 Aug 29 22:57:33.553059 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 529/1024] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:33 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:33.723640 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-38c414b6-8a9a-4b73-99a0-5a88a4dbe207 req-a4f3f92f-c377-4228-ad15-1873e3280011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0", "name": "network-vif-deleted", "tag": "2fa0d2d3-2692-42cb-8171-8661666ff0bf"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:33.734993 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-38c414b6-8a9a-4b73-99a0-5a88a4dbe207 req-a4f3f92f-c377-4228-ad15-1873e3280011 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:33.739832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-38c414b6-8a9a-4b73-99a0-5a88a4dbe207 req-a4f3f92f-c377-4228-ad15-1873e3280011 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:33.739832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-38c414b6-8a9a-4b73-99a0-5a88a4dbe207 req-a4f3f92f-c377-4228-ad15-1873e3280011 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:33.747492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-38c414b6-8a9a-4b73-99a0-5a88a4dbe207 req-a4f3f92f-c377-4228-ad15-1873e3280011 service nova] Creating event network-vif-deleted:2fa0d2d3-2692-42cb-8171-8661666ff0bf for instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 on hv-cinder-85426 Aug 29 22:57:33.752542 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-38c414b6-8a9a-4b73-99a0-5a88a4dbe207 req-a4f3f92f-c377-4228-ad15-1873e3280011 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032865 Aug 29 22:57:33.753256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 496/1025] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:57:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:57:34.564180 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:34.564808 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:34.571468 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:34.571960 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:34.572393 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:34.573118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:34.573573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:34.573989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:34.609064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:34.609530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:34.609983 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:34.610419 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lazy-loading 'fault' on Instance uuid 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:57:34.655538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:34.661390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7e8dd1fb-af6d-457c-a542-33ad85c252cc tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 200 len: 1331 microversion: 2.1 time: 0.101112 Aug 29 22:57:34.661955 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 530/1026] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:34 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 1331 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:35.683669 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:35.684438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:35.690522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:35.691000 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:35.691427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:35.692110 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:35.692554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:35.692999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:35.706452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 HTTP/1.1 Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:57:35.708086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 22:57:35.709778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0'} Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:57:35.711155 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 22:57:35.712701 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:57:35.714288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:57:35.714288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ea7d4787-3b03-430b-8270-1cb7b43a4176 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 404 len: 111 microversion: 2.1 time: 0.030600 Aug 29 22:57:35.714288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 497/1027] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:35 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:57:35.720191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-29aef5d5-5493-433d-9ef9-c067410c239e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '.version_select at 0x7efc5fb825e0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:35.804790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-29aef5d5-5493-433d-9ef9-c067410c239e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-681029915" status: 202 len: 0 microversion: 2.1 time: 0.089738 Aug 29 22:57:35.805309 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 531/1028] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Aug 29 22:57:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-681029915 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:57:36.585015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:36.585837 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:36.592385 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:36.592901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:36.593336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:36.594024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:36.594476 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:36.594897 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:36.676033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lazy-loading 'services' on Instance uuid 90c81fe3-5287-4f9b-8889-2286e532ad68 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:57:36.913068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-980ce1cd-41d3-4749-a027-09be3421a4e9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments/452bdfda-8651-4ce7-be39-b09acb1ab5f9" status: 202 len: 0 microversion: 2.1 time: 0.331848 Aug 29 22:57:36.913760 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 498/1029] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:57:36 2022] DELETE /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments/452bdfda-8651-4ce7-be39-b09acb1ab5f9 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:57:36.922669 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:36.924819 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:36.931573 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:36.931989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:36.932419 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:36.933138 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:36.933596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:36.934639 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:36.965529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0b02c42b-e8c1-4163-aa67-61529a51fc9f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047298 Aug 29 22:57:36.966085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 532/1030] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:57:36 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:57:37.979212 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:37.981880 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:37.988224 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:37.996276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:37.996276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:37.996276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:37.996276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:37.996655 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:38.017178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:38.021584 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-f4d58693-fa5d-4f51-a9f3-fcefba8c55a8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047323 Aug 29 22:57:38.022136 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 499/1031] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:57:37 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:57:38.088437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:38.089028 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:38.096526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:38.097045 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:38.097496 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:38.098243 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:38.098702 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:38.099119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:38.125438 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:57:38.216072 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:38.486602 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8aebb90b-bab9-484b-bb82-beea2b09c972 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 204 len: 0 microversion: 2.1 time: 0.401973 Aug 29 22:57:38.487266 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 533/1032] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:57:38 2022] DELETE /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:57:38.497133 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:38.498188 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:38.504769 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:38.505252 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:38.505673 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:38.506373 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:38.506820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:38.507235 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:38.645579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:38.653220 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5a78c63f-155e-4ec8-90d1-95e8458b0457 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1680 microversion: 2.1 time: 0.161073 Aug 29 22:57:38.653831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 500/1033] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:38 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:39.675688 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:39.676391 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:39.682793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:39.683272 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:39.683701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:39.684390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:39.684870 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:39.685833 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:39.822362 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:39.830844 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-09a08d6e-a2da-46b7-b1ce-bd7cb88250eb tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1680 microversion: 2.1 time: 0.159436 Aug 29 22:57:39.837951 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 534/1034] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:39 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:40.852067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:40.852710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:40.855154 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:40.860576 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:40.861086 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:40.861517 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:40.862208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:40.862657 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:40.863071 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:40.946240 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:40.954356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6e0bcd4f-eb6a-49bd-9038-61d5310132a6 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1612 microversion: 2.1 time: 0.106219 Aug 29 22:57:40.954917 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 501/1035] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:40 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1612 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:41.170506 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-ac94ba0e-bd94-4415-b887-5c36f22cfc8e req-ec3c1eb6-f215-40a9-b506-c5812d584699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90c81fe3-5287-4f9b-8889-2286e532ad68", "name": "network-vif-deleted", "tag": "e012ab5d-526a-49b1-9047-fa65495d9acc"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:41.181062 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-ac94ba0e-bd94-4415-b887-5c36f22cfc8e req-ec3c1eb6-f215-40a9-b506-c5812d584699 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:41.184709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-ac94ba0e-bd94-4415-b887-5c36f22cfc8e req-ec3c1eb6-f215-40a9-b506-c5812d584699 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:41.184709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-ac94ba0e-bd94-4415-b887-5c36f22cfc8e req-ec3c1eb6-f215-40a9-b506-c5812d584699 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:41.193686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-ac94ba0e-bd94-4415-b887-5c36f22cfc8e req-ec3c1eb6-f215-40a9-b506-c5812d584699 service nova] Creating event network-vif-deleted:e012ab5d-526a-49b1-9047-fa65495d9acc for instance 90c81fe3-5287-4f9b-8889-2286e532ad68 on hv-cinder-85426 Aug 29 22:57:41.198684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-ac94ba0e-bd94-4415-b887-5c36f22cfc8e req-ec3c1eb6-f215-40a9-b506-c5812d584699 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031931 Aug 29 22:57:41.200053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 535/1036] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:57:41.977616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:41.978233 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:41.986421 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:41.986921 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:41.987323 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:41.988017 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:41.988646 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:41.989099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:42.021713 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:42.022194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:42.022619 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:42.023055 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lazy-loading 'fault' on Instance uuid 90c81fe3-5287-4f9b-8889-2286e532ad68 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:57:42.066968 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:42.074927 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cbb702d3-3f41-46e3-814b-ddbb53bf80a3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 200 len: 1329 microversion: 2.1 time: 0.101175 Aug 29 22:57:42.075508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 502/1037] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:41 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:43.101385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:43.102061 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:43.104009 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:43.109843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:43.110322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:43.110753 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:43.111437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:43.111887 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:43.112304 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:43.125533 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 HTTP/1.1 Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:57:43.127123 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 22:57:43.128939 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '90c81fe3-5287-4f9b-8889-2286e532ad68'} Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:57:43.130087 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 22:57:43.131817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:57:43.133480 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:57:43.133480 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-77733dee-c73e-4e2b-a944-8ad15124a54d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 404 len: 111 microversion: 2.1 time: 0.031791 Aug 29 22:57:43.133480 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 536/1038] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:43 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:57:43.137194 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4bc71618-3128-4531-9a0e-3ca248533f56 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '.version_select at 0x7efc5fc8ed30>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:43.206418 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4bc71618-3128-4531-9a0e-3ca248533f56 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-89794724" status: 202 len: 0 microversion: 2.1 time: 0.072820 Aug 29 22:57:43.207008 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 503/1039] 10.222.0.52 () {58 vars in 1215 bytes} [Mon Aug 29 22:57:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-89794724 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:57:44.009957 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-547a08ca-8569-4adc-9c7c-59aacbfc79a1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: .version_select at 0x7efc5fb878b0>, body: {"keypair": {"name": "tempest-keypair-1429388164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqayB05u84XasyBRkIy53lGqkbsyPYqrW9URdjqPYo3UaAzYTXOq/7hXTtByqHMUdUXrlo8V8yrGc7qnOt4xkEetVczrIuJIUsfJzxwScw4XAot0c8aZsVnO6kvrvBVag=="}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:44.026089 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-547a08ca-8569-4adc-9c7c-59aacbfc79a1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:57:44.029938 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-547a08ca-8569-4adc-9c7c-59aacbfc79a1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:57:44.120462 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-547a08ca-8569-4adc-9c7c-59aacbfc79a1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114779 Aug 29 22:57:44.121203 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 537/1040] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:57:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:57:46.553368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-226706572", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c5a5718-95a5-4078-9ca0-1c8c805a3f99"}], "security_groups": [{"name": "tempest-securitygroup--105639568"}], "key_name": "tempest-keypair-1429388164", "user_data": "}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:46.658098 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] validate_networks() for [('3c5a5718-95a5-4078-9ca0-1c8c805a3f99', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:57:47.028925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:57:47.029351 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:57:47.029819 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:57:47.030222 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:57:47.031327 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:57:47.040025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:47.040495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:47.040975 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:47.041687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:47.042133 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:47.042548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:47.059706 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:57:47.063637 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:57:47.074550 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:57:47.076831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:57:47.230588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-09cb975e-b5a1-4667-8a45-5096991a15fd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.682657 Aug 29 22:57:47.231216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 504/1041] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:57:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 29 22:57:47.243504 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7f1a4240-5881-44b8-a031-1cd4a74d0a89 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:47.244121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7f1a4240-5881-44b8-a031-1cd4a74d0a89 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:47.303611 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7f1a4240-5881-44b8-a031-1cd4a74d0a89 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:47.310713 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7f1a4240-5881-44b8-a031-1cd4a74d0a89 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1241 microversion: 2.1 time: 0.072042 Aug 29 22:57:47.311270 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 538/1042] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:47 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:48.332854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:48.333513 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:48.340539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:48.341068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:48.341508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:48.342217 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:48.342651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:48.343175 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:48.408684 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:48.416657 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-c63b68f5-8b2b-459a-bcb0-30d5ce57e657 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1245 microversion: 2.1 time: 0.089131 Aug 29 22:57:48.417253 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 505/1043] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:48 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1245 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:49.436835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:49.437459 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:49.444465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:49.444986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:49.445456 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:49.446146 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:49.446635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:49.447058 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:49.510535 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:49.519004 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b4850770-fa16-4081-bdc1-8da05915160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1293 microversion: 2.1 time: 0.085978 Aug 29 22:57:49.519590 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 539/1044] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:49 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:50.551510 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:50.555438 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:50.567477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:50.567954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:50.568956 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:50.569842 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:50.570461 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:50.579377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:50.739519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:50.747178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cf3f5ff9-0470-48fa-901a-7928a75b2bf8 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.208111 Aug 29 22:57:50.747830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 506/1045] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:50 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:51.432021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-65fb36c6-cfdb-48ce-830c-dab476e45342 req-6ab0c6a3-1fc6-4243-a540-835628c993db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0ef09b-16ec-49c7-bbf8-9400efe3e020", "tag": "ad5c4d05-7575-4d02-8da0-ffe20d40bc4b"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:51.442344 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-65fb36c6-cfdb-48ce-830c-dab476e45342 req-6ab0c6a3-1fc6-4243-a540-835628c993db service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:51.442815 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-65fb36c6-cfdb-48ce-830c-dab476e45342 req-6ab0c6a3-1fc6-4243-a540-835628c993db service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:51.443242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-65fb36c6-cfdb-48ce-830c-dab476e45342 req-6ab0c6a3-1fc6-4243-a540-835628c993db service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:51.455198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-65fb36c6-cfdb-48ce-830c-dab476e45342 req-6ab0c6a3-1fc6-4243-a540-835628c993db service nova] Creating event network-changed:ad5c4d05-7575-4d02-8da0-ffe20d40bc4b for instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 on hv-cinder-85426 Aug 29 22:57:51.460359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-65fb36c6-cfdb-48ce-830c-dab476e45342 req-6ab0c6a3-1fc6-4243-a540-835628c993db service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031783 Aug 29 22:57:51.461069 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 540/1046] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:57:51.769887 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:51.770527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:51.777686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:51.778186 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:51.778625 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:51.779335 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:51.779792 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:51.780220 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:51.990351 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:51.999065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1e2bad76-bfc9-4051-845c-5cf9b33ee92a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.233655 Aug 29 22:57:51.999065 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 507/1047] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:51 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:57:53.021074 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:53.021771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:53.027863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:53.028342 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:53.028829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:53.029518 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:53.029968 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:53.030390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:53.159360 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:53.166969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9090f358-3163-4b81-b9fa-d761d378647a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.151305 Aug 29 22:57:53.167638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 541/1048] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:53 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:54.187915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:54.188531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:54.196020 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:54.196502 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:54.196976 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:54.197673 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:54.198128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:54.198549 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:54.337765 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:54.346038 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-02464e6a-f00e-456a-ac05-71ac603acc34 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.162167 Aug 29 22:57:54.346798 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 508/1049] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:54 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:55.367312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:55.367921 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:55.374235 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:55.374712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:55.375141 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:55.375824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:55.376271 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:55.376761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:55.511810 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:55.520689 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7c543106-d230-40fb-9180-bf49c326e89a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.157007 Aug 29 22:57:55.521295 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 542/1050] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:55 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:56.543926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:56.545024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:56.552474 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:56.552986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:56.553412 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:56.554095 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:56.554547 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:56.554955 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:56.685830 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:56.694033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-bd490187-761d-46df-87c3-956909421064 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.155262 Aug 29 22:57:56.694594 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 509/1051] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:56 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:57.490143 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-33d405ff-521d-4d19-b977-c1b773f93cda req-78acbad6-7fbf-407d-a32d-4227ab755ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ef09b-16ec-49c7-bbf8-9400efe3e020", "name": "network-vif-plugged", "status": "completed", "tag": "ad5c4d05-7575-4d02-8da0-ffe20d40bc4b"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:57:57.495491 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:57.500595 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-33d405ff-521d-4d19-b977-c1b773f93cda req-78acbad6-7fbf-407d-a32d-4227ab755ec6 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:57.501153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-33d405ff-521d-4d19-b977-c1b773f93cda req-78acbad6-7fbf-407d-a32d-4227ab755ec6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:57.501538 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-33d405ff-521d-4d19-b977-c1b773f93cda req-78acbad6-7fbf-407d-a32d-4227ab755ec6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:57.512649 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-33d405ff-521d-4d19-b977-c1b773f93cda req-78acbad6-7fbf-407d-a32d-4227ab755ec6 service nova] Creating event network-vif-plugged:ad5c4d05-7575-4d02-8da0-ffe20d40bc4b for instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 on hv-cinder-85426 Aug 29 22:57:57.517562 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-33d405ff-521d-4d19-b977-c1b773f93cda req-78acbad6-7fbf-407d-a32d-4227ab755ec6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031850 Aug 29 22:57:57.518191 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 543/1052] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:57:57.716694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:57.717339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:57.719193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:57.719861 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=6 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:57:57.726311 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:57.726849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:57.727292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:57.727999 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:57.728457 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:57.728916 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:57.859762 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:57.867972 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2f630188-4207-4267-a66b-2dd0b01af8f7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.155325 Aug 29 22:57:57.868587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 510/1053] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:57 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:57:58.890136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:57:58.890730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:57:58.897287 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:58.897757 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:58.898181 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:58.898849 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:57:58.899292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:57:58.899703 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:57:59.032298 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:57:59.041751 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-1df99923-2aa7-4f20-839f-bda4a727e53e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1366 microversion: 2.1 time: 0.156276 Aug 29 22:57:59.042553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 544/1054] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:57:58 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:00.065582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:00.066198 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:00.072645 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:00.073158 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:00.073596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:00.074285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:00.074743 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:00.075167 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:00.208085 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:00.216117 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1d8c5609-07e0-4bbb-9cb0-3b93469dd54b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1557 microversion: 2.1 time: 0.155525 Aug 29 22:58:00.216691 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 511/1055] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:00 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:00.237470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:00.237973 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:00.244412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:00.244927 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:00.245360 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:00.246046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:00.246499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:00.246916 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:00.323015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3355c3e6-aabc-484d-92a6-1e9a3e2eaf0a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089911 Aug 29 22:58:00.323608 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 545/1056] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:58:00 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:01.647522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-a252d982-018f-42fd-81cb-4c5df02a0d0e req-2358d29b-c5ff-4d11-9bca-d85e858fed32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd0ef09b-16ec-49c7-bbf8-9400efe3e020", "tag": "ad5c4d05-7575-4d02-8da0-ffe20d40bc4b"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:01.657375 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a252d982-018f-42fd-81cb-4c5df02a0d0e req-2358d29b-c5ff-4d11-9bca-d85e858fed32 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:01.657930 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a252d982-018f-42fd-81cb-4c5df02a0d0e req-2358d29b-c5ff-4d11-9bca-d85e858fed32 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:01.659088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a252d982-018f-42fd-81cb-4c5df02a0d0e req-2358d29b-c5ff-4d11-9bca-d85e858fed32 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:01.670663 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-a252d982-018f-42fd-81cb-4c5df02a0d0e req-2358d29b-c5ff-4d11-9bca-d85e858fed32 service nova] Creating event network-changed:ad5c4d05-7575-4d02-8da0-ffe20d40bc4b for instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 on hv-cinder-85426 Aug 29 22:58:01.676766 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-a252d982-018f-42fd-81cb-4c5df02a0d0e req-2358d29b-c5ff-4d11-9bca-d85e858fed32 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033467 Aug 29 22:58:01.677491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 512/1057] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:12.745701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:12.746167 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=44,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:12.749861 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:12.750355 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:12.757324 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:12.760924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:12.760924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:12.760924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:12.760924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:12.761471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:12.784617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:58:13.238969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-85e6fbe4-4fc4-4218-b380-7f79fc21530e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 204 len: 0 microversion: 2.1 time: 0.495110 Aug 29 22:58:13.239735 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 546/1058] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:58:12 2022] DELETE /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:58:13.246004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:13.246792 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=67 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:13.250969 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:13.251639 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:13.257902 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:13.258385 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:13.258828 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:13.259528 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:13.259986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:13.260417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:13.398850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:13.406824 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-265b2685-841f-46b8-b9d3-ab955c36e2e2 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1577 microversion: 2.1 time: 0.162407 Aug 29 22:58:13.407387 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 513/1059] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:13 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:14.429790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:14.430487 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:14.436855 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:14.437340 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:14.437784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:14.438476 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:14.439431 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:14.439848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:14.584185 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:14.590888 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-43cc9b1c-069c-4311-8a0f-e0c728a2aa00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1577 microversion: 2.1 time: 0.165329 Aug 29 22:58:14.591449 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 547/1060] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:14 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:15.613683 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:15.614298 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:15.621281 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:15.623736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:15.623736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:15.623736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:15.623736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:15.624093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:15.709524 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:15.717589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-43ff46b4-dedc-4552-a582-c1c779f933ea tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1509 microversion: 2.1 time: 0.108435 Aug 29 22:58:15.718372 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 514/1061] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:15 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1509 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:15.940014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-22972bad-91dc-46ef-b32b-a8f66d43f2c0 req-056b4cc0-aa4f-45da-8543-0c5ffd297e66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc481bca-3e90-4125-bf1a-ba29d4218b17", "name": "network-vif-deleted", "tag": "fd84b633-713d-417d-a59b-0ba0d9a4d3c4"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:15.950547 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-22972bad-91dc-46ef-b32b-a8f66d43f2c0 req-056b4cc0-aa4f-45da-8543-0c5ffd297e66 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:15.951623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-22972bad-91dc-46ef-b32b-a8f66d43f2c0 req-056b4cc0-aa4f-45da-8543-0c5ffd297e66 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:15.951623 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-22972bad-91dc-46ef-b32b-a8f66d43f2c0 req-056b4cc0-aa4f-45da-8543-0c5ffd297e66 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:15.964029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-22972bad-91dc-46ef-b32b-a8f66d43f2c0 req-056b4cc0-aa4f-45da-8543-0c5ffd297e66 service nova] Creating event network-vif-deleted:fd84b633-713d-417d-a59b-0ba0d9a4d3c4 for instance cc481bca-3e90-4125-bf1a-ba29d4218b17 on hv-cinder-85426 Aug 29 22:58:15.969052 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-22972bad-91dc-46ef-b32b-a8f66d43f2c0 req-056b4cc0-aa4f-45da-8543-0c5ffd297e66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033195 Aug 29 22:58:15.969852 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 548/1062] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:16.742594 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:16.744219 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:16.750929 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:16.753694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:16.753694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:16.753694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:16.753694 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:16.754106 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:16.791602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:16.792093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:16.792564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:16.793047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lazy-loading 'fault' on Instance uuid cc481bca-3e90-4125-bf1a-ba29d4218b17 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:58:17.041053 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:17.048092 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6cba4c93-69e3-4e9e-a854-580a81dca6e5 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 200 len: 1229 microversion: 2.1 time: 0.312969 Aug 29 22:58:17.049250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 515/1063] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:16 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 1229 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:18.070907 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:18.071603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:18.078224 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:18.078708 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:18.079258 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:18.080196 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:18.080657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:18.081113 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:18.094424 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] HTTP exception thrown: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Request method failure captured: Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 HTTP/1.1 Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPbNhF2nx5qJMYcrsnCT9_ppuwiiYpejkzDIVJwY_IDYIBBps0FqhwnFlBpvvOHlxptp1FRies19Fo4zG_47pX0WQlpW-u3sc2Jq0y6WvltkV2z81PRvXT6vYaxXS0ulW-diF0blNlxZLxWODDT1JiL2eAZzJFEk8UO3uHujAsI3qE Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 98941ac6692045859aa7639192603764 Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:58:18.096102 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_98941ac6692045859aa7639192603764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/98941ac6692045859aa7639192603764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-TestVolumeBootPattern-231778945 Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 98941ac6692045859aa7639192603764 Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-TestVolumeBootPattern-231778945-project Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: df23a24f4d5948deb641de1cefad1f69 Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-TestVolumeBootPattern-231778945-project Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 22:58:18.097873 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'cc481bca-3e90-4125-bf1a-ba29d4218b17'} Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:58:18.098978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 22:58:18.100617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:18.102118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Returning 404 to user: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:58:18.102118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6fd4d551-fa4d-412c-9fac-df8042817274 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 404 len: 111 microversion: 2.1 time: 0.030811 Aug 29 22:58:18.102118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 549/1064] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:18 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:58:18.195717 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1205268691", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-766470335", "security_groups": [{"name": "tempest-secgroup-smoke-1435890377"}], "block_device_mapping_v2": [{"uuid": "97e33abc-a5e1-44ea-8d55-efeb02d22d61", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2773dfeb-fc93-411d-adc3-1d803860c0cc"}]}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:18.308972 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.network.neutron [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] validate_networks() for [('2773dfeb-fc93-411d-adc3-1d803860c0cc', None, None, None, None, None)] {{(pid=139066) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:58:18.684552 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Flavor limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:58:18.685006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Image limits 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:58:18.685475 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Flavor pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:58:18.685885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Image pref 0:0:0 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:58:18.686293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.virt.hardware [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:58:18.695526 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:18.696007 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:18.696434 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:18.697200 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:18.697644 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:18.698061 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:18.715285 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for project 98941ac6692045859aa7639192603764. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:58:18.719162 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for user df23a24f4d5948deb641de1cefad1f69 and project 98941ac6692045859aa7639192603764. Resources: {'ram', 'cores', 'instances'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:58:18.781094 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Going to run 1 instances... {{(pid=139066) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:58:18.783278 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='97e33abc-a5e1-44ea-8d55-efeb02d22d61',volume_size=None,volume_type=None)] {{(pid=139066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:58:19.192334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-885afbaa-ee5e-4821-b389-984728c553eb tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.000419 Aug 29 22:58:19.193016 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 516/1065] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:58:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:58:19.204289 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-610d285b-7770-40bb-bcb0-fa14045e93fe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:19.206178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-610d285b-7770-40bb-bcb0-fa14045e93fe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:19.315403 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-610d285b-7770-40bb-bcb0-fa14045e93fe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:19.323003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-610d285b-7770-40bb-bcb0-fa14045e93fe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1094 microversion: 2.1 time: 0.122566 Aug 29 22:58:19.323479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 550/1066] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:19 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1094 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:20.344519 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:20.345358 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:20.351687 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:20.352178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:20.352620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:20.353356 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:20.353815 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:20.354241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:20.418626 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:20.427004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-21414806-3faa-49e2-bdd0-1994496fcea7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1144 microversion: 2.1 time: 0.086839 Aug 29 22:58:20.427558 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 517/1067] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:20 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:21.447835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:21.448618 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:21.454858 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:21.460079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:21.460079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:21.460079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:21.460079 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:21.460498 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:21.523471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:21.531247 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-47b7cc5c-5713-4c2f-b4f7-5aa2aa2c39d1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1210 microversion: 2.1 time: 0.087648 Aug 29 22:58:21.532702 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 551/1068] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:21 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:22.560832 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:22.561442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:22.569004 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:22.569508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:22.569925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:22.570722 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:22.571333 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:22.571756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:22.780248 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:22.789315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-206fe38f-597c-4a33-9f4e-1a53750dbc4e tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1278 microversion: 2.1 time: 0.232355 Aug 29 22:58:22.789917 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 518/1069] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:22 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1278 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:22.940466 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-13e0bb53-83be-4354-95bc-d8aba4ec6424 req-5e778420-1d4c-457a-a53f-a12a3e55bfa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95eb6982-122b-42c2-a914-d42b2a64b8b6", "tag": "ec64c87c-bc7f-4c57-9f3f-1ceeec96166e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:22.947894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-13e0bb53-83be-4354-95bc-d8aba4ec6424 req-5e778420-1d4c-457a-a53f-a12a3e55bfa5 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:22.948364 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-13e0bb53-83be-4354-95bc-d8aba4ec6424 req-5e778420-1d4c-457a-a53f-a12a3e55bfa5 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:22.948821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-13e0bb53-83be-4354-95bc-d8aba4ec6424 req-5e778420-1d4c-457a-a53f-a12a3e55bfa5 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:22.960051 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-13e0bb53-83be-4354-95bc-d8aba4ec6424 req-5e778420-1d4c-457a-a53f-a12a3e55bfa5 service nova] Creating event network-changed:ec64c87c-bc7f-4c57-9f3f-1ceeec96166e for instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 on hv-cinder-85426 Aug 29 22:58:22.964919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-13e0bb53-83be-4354-95bc-d8aba4ec6424 req-5e778420-1d4c-457a-a53f-a12a3e55bfa5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031016 Aug 29 22:58:22.967775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 552/1070] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:23.811497 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:23.812057 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:23.819389 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:23.819877 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:23.820311 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:23.821048 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:23.821503 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:23.821922 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:24.007391 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:24.015005 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cec7e76b-d138-4d1f-b5ef-36b52f4ed715 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.207623 Aug 29 22:58:24.015564 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 519/1071] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:23 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:25.037151 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:25.037838 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:25.043882 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:25.044359 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:25.044818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:25.045503 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:25.045954 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:25.046380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:25.180554 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:25.188217 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-21177cf5-5d7a-4e76-a018-369e862cbf32 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156120 Aug 29 22:58:25.189308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 553/1072] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:25 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:26.210144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:26.210774 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:26.217093 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:26.217570 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:26.218002 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:26.218677 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:26.219121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:26.219602 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:26.348088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:26.355819 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e401dcc8-5e4a-44f5-a576-cd135dea10be tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.149928 Aug 29 22:58:26.356380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 520/1073] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:26 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:27.377368 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:27.377974 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:27.384267 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:27.384770 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:27.385205 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:27.385886 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:27.386341 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:27.386759 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:27.520613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:27.528329 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a727c4ee-74bc-4615-bf2e-a64a9f8d1a8a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.155180 Aug 29 22:58:27.528910 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 554/1074] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:27 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:28.550118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:28.550756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:28.557428 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:28.557907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:28.558339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:28.559022 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:28.559470 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:28.559891 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:28.694196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:28.701843 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-761e9342-1798-4d4c-b721-3ac6dd244280 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156171 Aug 29 22:58:28.702410 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 521/1075] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:28 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:29.726514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:29.727112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:29.729588 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:29.735894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:29.736374 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:29.736831 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:29.737525 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:29.743701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:29.743701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:29.868580 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:29.876356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7015d7b8-1d88-4468-9d68-1ee3dde6ba69 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156040 Aug 29 22:58:29.876952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 555/1076] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:29 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:30.897405 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:30.898156 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:30.899789 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:30.900466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=6 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:30.905987 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:30.912112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:30.912112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:30.912112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:30.912112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:30.912508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:31.043416 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:31.051836 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-88afb3df-547e-4cf8-8b6e-2e0f97cc0535 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.159241 Aug 29 22:58:31.052392 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 522/1077] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:30 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:32.072558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:32.073306 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:32.079931 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:32.080404 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:32.080860 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:32.081555 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:32.082002 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:32.082421 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:32.230589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:32.238911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f18e2d7f-5b8b-4042-805d-1707d553eb62 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.170174 Aug 29 22:58:32.239470 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 556/1078] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:32 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:33.259582 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:33.260121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:33.266603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:33.267031 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:33.267463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:33.268164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:33.268596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:33.269044 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:33.401765 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:33.410225 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-29f40c97-3dbd-48a8-a1e0-a9e8f1b40c00 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.154607 Aug 29 22:58:33.410872 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 523/1079] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:33 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:33.622473 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-ba5072dc-4c53-4b8d-a6c3-f348b89b1acf req-20a82fa4-7aa0-4b89-8bc2-afc60df2a07b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95eb6982-122b-42c2-a914-d42b2a64b8b6", "name": "network-vif-plugged", "status": "completed", "tag": "ec64c87c-bc7f-4c57-9f3f-1ceeec96166e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:33.633447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-ba5072dc-4c53-4b8d-a6c3-f348b89b1acf req-20a82fa4-7aa0-4b89-8bc2-afc60df2a07b service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:33.636454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-ba5072dc-4c53-4b8d-a6c3-f348b89b1acf req-20a82fa4-7aa0-4b89-8bc2-afc60df2a07b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:33.636454 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-ba5072dc-4c53-4b8d-a6c3-f348b89b1acf req-20a82fa4-7aa0-4b89-8bc2-afc60df2a07b service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:33.645837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-ba5072dc-4c53-4b8d-a6c3-f348b89b1acf req-20a82fa4-7aa0-4b89-8bc2-afc60df2a07b service nova] Creating event network-vif-plugged:ec64c87c-bc7f-4c57-9f3f-1ceeec96166e for instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 on hv-cinder-85426 Aug 29 22:58:33.651168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-ba5072dc-4c53-4b8d-a6c3-f348b89b1acf req-20a82fa4-7aa0-4b89-8bc2-afc60df2a07b service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032104 Aug 29 22:58:33.651749 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 557/1080] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:34.432386 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:34.432982 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:34.440572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:34.441082 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:34.441569 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:34.442259 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:34.442712 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:34.443142 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:34.576976 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:34.585986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-417ca19b-52ba-4692-93eb-0cbb2b75ef78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.156239 Aug 29 22:58:34.585986 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 524/1081] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:34 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:35.607261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:35.607958 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:35.615894 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:35.616373 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:35.616825 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:35.617516 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:35.617969 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:35.618392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:35.755147 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:35.762801 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3da9dc0b-57c8-4a3b-9e5c-b00f68c8180d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1266 microversion: 2.1 time: 0.160035 Aug 29 22:58:35.763413 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 558/1082] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:35 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:36.784216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:36.784859 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:36.791304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:36.791791 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:36.792231 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:36.792967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:36.793426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:36.793852 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:36.926481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:36.934146 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-97c7ff6b-c603-46d5-9d32-aeb715e4f689 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1453 microversion: 2.1 time: 0.154656 Aug 29 22:58:36.934710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 525/1083] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:36 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:36.956101 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:36.956919 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:36.963307 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:36.963775 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:36.964198 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:36.964905 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:36.965348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:36.965758 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:37.105544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:37.113522 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-500d2816-2540-4248-a707-adedfd6df778 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1453 microversion: 2.1 time: 0.162039 Aug 29 22:58:37.114083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 559/1084] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:36 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1453 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:37.834771 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:37.834771 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:37.840567 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:37.841250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:37.841705 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:37.842414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:37.842875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:37.843300 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:37.867193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d3c47997-0ab3-434d-bd18-9901d32565d3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/ips" status: 200 len: 150 microversion: 2.1 time: 0.040602 Aug 29 22:58:37.867771 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 526/1085] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:58:37 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:39.230345 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-5a56a2bd-7cb7-485f-859a-15747fa301d0 req-195b30e0-b7e9-42a7-84df-c6f35a8669f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95eb6982-122b-42c2-a914-d42b2a64b8b6", "tag": "ec64c87c-bc7f-4c57-9f3f-1ceeec96166e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:39.241356 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-5a56a2bd-7cb7-485f-859a-15747fa301d0 req-195b30e0-b7e9-42a7-84df-c6f35a8669f6 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:39.241835 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-5a56a2bd-7cb7-485f-859a-15747fa301d0 req-195b30e0-b7e9-42a7-84df-c6f35a8669f6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:39.242264 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-5a56a2bd-7cb7-485f-859a-15747fa301d0 req-195b30e0-b7e9-42a7-84df-c6f35a8669f6 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:39.253865 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-5a56a2bd-7cb7-485f-859a-15747fa301d0 req-195b30e0-b7e9-42a7-84df-c6f35a8669f6 service nova] Creating event network-changed:ec64c87c-bc7f-4c57-9f3f-1ceeec96166e for instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 on hv-cinder-85426 Aug 29 22:58:39.258729 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-5a56a2bd-7cb7-485f-859a-15747fa301d0 req-195b30e0-b7e9-42a7-84df-c6f35a8669f6 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032083 Aug 29 22:58:39.259325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 560/1086] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:58:39.618427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5bdddbf-2c22-436e-96a1-aa8223cfc86a"}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:39.620923 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:39.627806 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:39.628379 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:39.628857 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:39.629658 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:39.630113 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:39.630536 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:40.446948 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d66febe0-513f-4c95-b4c7-063eab30b6ff tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.832666 Aug 29 22:58:40.447585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 527/1087] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:58:39 2022] POST /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:47.394766 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:47.395460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:47.398348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:47.398698 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-84817cc9-eed0-4aa8-98e4-1b4b9ea5778f req-42705c31-72e0-4bf7-804f-35624120ea45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "983a88ca-ab2c-40f2-8cc9-075c9783408b", "tag": "91df5732-ae39-46e4-8d12-2571816bc572"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:47.410917 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:47.413415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:47.413862 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:47.414571 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:47.415023 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:47.415444 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:47.420747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:47.423672 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:47.423672 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-84817cc9-eed0-4aa8-98e4-1b4b9ea5778f req-42705c31-72e0-4bf7-804f-35624120ea45 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:47.423907 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-84817cc9-eed0-4aa8-98e4-1b4b9ea5778f req-42705c31-72e0-4bf7-804f-35624120ea45 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:47.424173 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-84817cc9-eed0-4aa8-98e4-1b4b9ea5778f req-42705c31-72e0-4bf7-804f-35624120ea45 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:47.439081 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:58:47.446620 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-84817cc9-eed0-4aa8-98e4-1b4b9ea5778f req-42705c31-72e0-4bf7-804f-35624120ea45 service nova] Creating event network-changed:91df5732-ae39-46e4-8d12-2571816bc572 for instance 983a88ca-ab2c-40f2-8cc9-075c9783408b on hv-cinder-85426 Aug 29 22:58:47.451814 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-84817cc9-eed0-4aa8-98e4-1b4b9ea5778f req-42705c31-72e0-4bf7-804f-35624120ea45 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069512 Aug 29 22:58:47.456288 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 528/1088] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:47.461603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:58:47.757691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a96fca98-a81a-48a2-bc6a-db719abf05b0 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "DELETE /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 204 len: 0 microversion: 2.1 time: 0.377570 Aug 29 22:58:47.759255 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 561/1089] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:58:47 2022] DELETE /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:58:47.768487 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:47.769344 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:47.776919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:47.777399 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:47.777910 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:47.778596 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:47.779036 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:47.779452 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:47.924417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:47.935350 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-1485d33e-21f9-48bb-a48a-1f0865e943c8 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.171662 Aug 29 22:58:47.936133 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 529/1090] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:47 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:58:48.000204 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d5bdddbf-2c22-436e-96a1-aa8223cfc86a"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:48.002661 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:48.009308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.009790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.010222 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:48.010922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.011369 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.011786 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:48.095216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Invalid volume: volume d5bdddbf-2c22-436e-96a1-aa8223cfc86a is already attached to instances: fd0ef09b-16ec-49c7-bbf8-9400efe3e020 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: POST /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments HTTP/1.1 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 74 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:58:48.097018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {"volumeAttachment": {"volumeId": "d5bdddbf-2c22-436e-96a1-aa8223cfc86a"}} Aug 29 22:58:48.098761 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Invalid volume: volume d5bdddbf-2c22-436e-96a1-aa8223cfc86a is already attached to instances: fd0ef09b-16ec-49c7-bbf8-9400efe3e020 Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'server_id': 'fd0ef09b-16ec-49c7-bbf8-9400efe3e020', 'body': {'volumeAttachment': {'volumeId': 'd5bdddbf-2c22-436e-96a1-aa8223cfc86a'}}} Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d5bdddbf-2c22-436e-96a1-aa8223cfc86a is already attached to instances: fd0ef09b-16ec-49c7-bbf8-9400efe3e020 Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:48.099765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d5bdddbf-2c22-436e-96a1-aa8223cfc86a is already attached to instances: fd0ef09b-16ec-49c7-bbf8-9400efe3e020 Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:48.107427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d5bdddbf-2c22-436e-96a1-aa8223cfc86a is already attached to instances: fd0ef09b-16ec-49c7-bbf8-9400efe3e020 Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 400 to user: Invalid volume: volume d5bdddbf-2c22-436e-96a1-aa8223cfc86a is already attached to instances: fd0ef09b-16ec-49c7-bbf8-9400efe3e020 {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-326c4f28-b26f-490d-b660-6341075dbd63 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102905 Aug 29 22:58:48.109821 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 562/1091] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:58:47 2022] POST /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 29 22:58:48.173995 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:48.174493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:48.181088 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.181572 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.182006 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:48.182691 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.183143 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.183587 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:48.275189 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lazy-loading 'services' on Instance uuid fd0ef09b-16ec-49c7-bbf8-9400efe3e020 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:58:48.510697 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-36960072-4044-472a-b6ab-476a1eb6a773 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments/d5bdddbf-2c22-436e-96a1-aa8223cfc86a" status: 202 len: 0 microversion: 2.1 time: 0.340909 Aug 29 22:58:48.511372 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 530/1092] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:58:48 2022] DELETE /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments/d5bdddbf-2c22-436e-96a1-aa8223cfc86a => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:58:48.520239 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:48.522375 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:48.530076 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.530549 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.530973 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:48.531872 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.532327 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.532766 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:48.563705 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f582bf7d-daa3-4552-84ce-e359418adffa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047464 Aug 29 22:58:48.564257 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 563/1093] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:58:48 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:48.957400 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:48.958098 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:48.964767 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.965257 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.965690 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:48.966430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:48.966884 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:48.967332 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:49.175724 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:49.183698 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0e22c461-7780-4e1b-bed1-79e14312d20d tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1569 microversion: 2.1 time: 0.230608 Aug 29 22:58:49.184265 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 531/1094] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:48 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:49.576048 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:49.578738 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:49.585376 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:49.592837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:49.592837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:49.592837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:49.592837 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:49.593215 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:49.617347 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-af31c609-e5f1-415d-beb7-3cb45d13d272 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045206 Aug 29 22:58:49.617892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 564/1095] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:58:49 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:50.206304 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:50.207321 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:50.215091 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:50.215715 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:50.216257 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:50.217186 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:50.217776 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:50.218308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:50.391859 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:50.403089 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4a2f9178-c735-4324-bc29-119ff57e28af tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1450 microversion: 2.1 time: 0.199400 Aug 29 22:58:50.414908 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 532/1096] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:50 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1450 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:50.457364 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-5c713512-aa6b-4d8e-9edf-34edc96a6d0c req-622c0da2-ddbd-450e-bc3b-4334d1e9f2e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "983a88ca-ab2c-40f2-8cc9-075c9783408b", "name": "network-vif-deleted", "tag": "91df5732-ae39-46e4-8d12-2571816bc572"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:50.466675 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-5c713512-aa6b-4d8e-9edf-34edc96a6d0c req-622c0da2-ddbd-450e-bc3b-4334d1e9f2e4 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:50.467153 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-5c713512-aa6b-4d8e-9edf-34edc96a6d0c req-622c0da2-ddbd-450e-bc3b-4334d1e9f2e4 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:50.467581 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-5c713512-aa6b-4d8e-9edf-34edc96a6d0c req-622c0da2-ddbd-450e-bc3b-4334d1e9f2e4 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:50.480112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-5c713512-aa6b-4d8e-9edf-34edc96a6d0c req-622c0da2-ddbd-450e-bc3b-4334d1e9f2e4 service nova] Creating event network-vif-deleted:91df5732-ae39-46e4-8d12-2571816bc572 for instance 983a88ca-ab2c-40f2-8cc9-075c9783408b on hv-cinder-85426 Aug 29 22:58:50.485811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-5c713512-aa6b-4d8e-9edf-34edc96a6d0c req-622c0da2-ddbd-450e-bc3b-4334d1e9f2e4 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032233 Aug 29 22:58:50.486392 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 565/1097] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:50.630133 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:50.632441 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:50.638671 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:50.639094 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:50.639926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:50.640292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:50.641221 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:50.641459 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:50.673107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ef520491-ec4a-41ff-b09a-8d0001e65c78 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045539 Aug 29 22:58:50.673107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 533/1098] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 22:58:50 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 22:58:50.736667 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:50.737415 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:50.743818 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:50.749558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:50.749558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:50.749558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:50.749558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:50.750084 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:50.775364 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 22:58:51.122699 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b4f7ce48-7cab-4e72-a543-e1d339a9f0d1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 204 len: 0 microversion: 2.1 time: 0.391223 Aug 29 22:58:51.123298 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 566/1099] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 22:58:50 2022] DELETE /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 22:58:51.131432 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:51.132259 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:51.138050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:51.138532 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:51.138963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:51.139652 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:51.140150 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:51.141182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:51.281071 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:51.289137 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-140e568a-414a-450e-8c66-b20108dbb8dd tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1681 microversion: 2.1 time: 0.161532 Aug 29 22:58:51.289708 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 534/1100] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:51 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:51.426911 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:51.427589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:51.433587 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:51.434067 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:51.434502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:51.435189 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:51.435648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:51.436056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:51.498517 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:51.507188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0ab174b4-c654-43b4-aee9-575756c28c8e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1219 microversion: 2.1 time: 0.085118 Aug 29 22:58:51.507944 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 567/1101] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:51 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:52.310867 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:52.311458 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:52.317994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:52.318481 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:52.318919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:52.319622 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:52.320078 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:52.320517 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:52.450758 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:52.459009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7de771da-53d8-4778-b285-94e2194a8e93 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1681 microversion: 2.1 time: 0.152162 Aug 29 22:58:52.459829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 535/1102] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:52 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:52.528412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:52.528980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:52.536609 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:52.537155 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:52.537589 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:52.538288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:52.538790 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:52.539156 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:52.608093 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5f04bf8fdc2c4451a3cb6a9929273973', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1e766828cca43808ba55f00a50c53f9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:52.617472 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3042ae4e-ba2a-4c91-a3c2-dc73e81c1863 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 200 len: 1219 microversion: 2.1 time: 0.092869 Aug 29 22:58:52.618097 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 568/1103] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:52 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:53.481254 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:53.482290 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:53.489771 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:53.493463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:53.493463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:53.493463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:53.493463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:53.493831 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:53.639867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:53.640663 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] [instance: 983a88ca-ab2c-40f2-8cc9-075c9783408b] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:53.648255 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:53.649170 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:53.649687 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:53.650593 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:53.651119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:53.651599 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:53.665575 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] HTTP exception thrown: Instance 983a88ca-ab2c-40f2-8cc9-075c9783408b could not be found. Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Request method failure captured: Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b HTTP/1.1 Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUN_s1OMAbuFSRDF0DdnvZ_3nkIYI7wDyy5BvWq2hVO3yl_ZeIPF_Is_4Ht9oMK6zOkHJ0PsIyE6-sUR2-JsH8rPFPPUw4MfnCTbI9v3M9BhVmyrb3XAMjeTOZYi537q4Bf25QnkKZrPEqJ6N4VaM4isNJw-FiWjYQs-2uORHlG4-0M Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: e1e766828cca43808ba55f00a50c53f9 Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-TestShelveInstance-742035695 Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 22:58:53.667843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_e1e766828cca43808ba55f00a50c53f9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/e1e766828cca43808ba55f00a50c53f9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1e766828cca43808ba55f00a50c53f9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/e1e766828cca43808ba55f00a50c53f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-TestShelveInstance-742035695 Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: e1e766828cca43808ba55f00a50c53f9 Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-TestShelveInstance-742035695 Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-TestShelveInstance-742035695-project Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: 5f04bf8fdc2c4451a3cb6a9929273973 Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-TestShelveInstance-742035695-project Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 983a88ca-ab2c-40f2-8cc9-075c9783408b could not be found. Aug 29 22:58:53.669607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '983a88ca-ab2c-40f2-8cc9-075c9783408b'} Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 983a88ca-ab2c-40f2-8cc9-075c9783408b could not be found. Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:58:53.670605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 983a88ca-ab2c-40f2-8cc9-075c9783408b could not be found. Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 983a88ca-ab2c-40f2-8cc9-075c9783408b could not be found. Aug 29 22:58:53.672642 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 22:58:53.674036 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Returning 404 to user: Instance 983a88ca-ab2c-40f2-8cc9-075c9783408b could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:58:53.674036 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4040e868-bb2f-4abc-ae82-d34994cb994e tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b" status: 404 len: 111 microversion: 2.1 time: 0.034053 Aug 29 22:58:53.674036 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 569/1104] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:53 2022] GET /compute/v2.1/servers/983a88ca-ab2c-40f2-8cc9-075c9783408b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:58:53.674304 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-bda4c2cf-65da-471c-8b17-780ef47c3db5 req-dd3e66ea-7f7e-4b25-86fd-4562e07e6a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ef09b-16ec-49c7-bbf8-9400efe3e020", "name": "network-vif-unplugged", "status": "completed", "tag": "ad5c4d05-7575-4d02-8da0-ffe20d40bc4b"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:53.683733 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bda4c2cf-65da-471c-8b17-780ef47c3db5 req-dd3e66ea-7f7e-4b25-86fd-4562e07e6a2c service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:53.684231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bda4c2cf-65da-471c-8b17-780ef47c3db5 req-dd3e66ea-7f7e-4b25-86fd-4562e07e6a2c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:53.684650 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-bda4c2cf-65da-471c-8b17-780ef47c3db5 req-dd3e66ea-7f7e-4b25-86fd-4562e07e6a2c service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:53.696627 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-bda4c2cf-65da-471c-8b17-780ef47c3db5 req-dd3e66ea-7f7e-4b25-86fd-4562e07e6a2c service nova] Creating event network-vif-unplugged:ad5c4d05-7575-4d02-8da0-ffe20d40bc4b for instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 on hv-cinder-85426 Aug 29 22:58:53.701594 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-bda4c2cf-65da-471c-8b17-780ef47c3db5 req-dd3e66ea-7f7e-4b25-86fd-4562e07e6a2c service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030658 Aug 29 22:58:53.702261 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 570/1105] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:53.741585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:53.750603 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-d714bf25-611e-4b0c-bdd5-e2f84ee26998 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1681 microversion: 2.1 time: 0.272851 Aug 29 22:58:53.751698 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 536/1106] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:53 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:53.937032 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-80b7f17c-8adc-4975-8dee-41681a72f940 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] Calling method '.version_select at 0x7efc5fead550>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:54.032126 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-80b7f17c-8adc-4975-8dee-41681a72f940 tempest-TestShelveInstance-742035695 tempest-TestShelveInstance-742035695-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1374677275" status: 202 len: 0 microversion: 2.1 time: 0.101683 Aug 29 22:58:54.032993 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 571/1107] 10.222.0.52 () {58 vars in 1254 bytes} [Mon Aug 29 22:58:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1374677275 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 22:58:54.230130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-a6341ee7-31f7-4af9-8b1a-165292836591 req-308cf5cf-8377-4976-8a7e-616156ad7902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd0ef09b-16ec-49c7-bbf8-9400efe3e020", "name": "network-vif-deleted", "tag": "ad5c4d05-7575-4d02-8da0-ffe20d40bc4b"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:54.241084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a6341ee7-31f7-4af9-8b1a-165292836591 req-308cf5cf-8377-4976-8a7e-616156ad7902 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:54.241566 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a6341ee7-31f7-4af9-8b1a-165292836591 req-308cf5cf-8377-4976-8a7e-616156ad7902 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:54.242193 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a6341ee7-31f7-4af9-8b1a-165292836591 req-308cf5cf-8377-4976-8a7e-616156ad7902 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:54.256489 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-a6341ee7-31f7-4af9-8b1a-165292836591 req-308cf5cf-8377-4976-8a7e-616156ad7902 service nova] Creating event network-vif-deleted:ad5c4d05-7575-4d02-8da0-ffe20d40bc4b for instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 on hv-cinder-85426 Aug 29 22:58:54.261992 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-a6341ee7-31f7-4af9-8b1a-165292836591 req-308cf5cf-8377-4976-8a7e-616156ad7902 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037059 Aug 29 22:58:54.262885 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 537/1108] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:54.774829 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:54.775553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:54.782764 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:54.783480 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:54.783914 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:54.784628 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:54.785100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:54.785530 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:54.820501 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:54.821029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:54.821461 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:54.821913 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lazy-loading 'fault' on Instance uuid fd0ef09b-16ec-49c7-bbf8-9400efe3e020 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 22:58:54.867693 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:58:54.876680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-a6863c80-dc22-4c40-8859-e3c9391be8bf tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 200 len: 1331 microversion: 2.1 time: 0.105948 Aug 29 22:58:54.877288 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 572/1109] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:54 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:58:55.899284 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:55.900654 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:58:55.909111 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:55.909595 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:55.910029 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:55.910763 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:58:55.911174 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:58:55.911600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:58:55.926442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 HTTP/1.1 Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 22:58:55.928305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 22:58:55.929967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'fd0ef09b-16ec-49c7-bbf8-9400efe3e020'} Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 22:58:55.930905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 22:58:55.932403 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 22:58:55.934482 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 22:58:55.935334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b2068b29-a8cb-4e77-8778-d5f18dfce234 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 404 len: 111 microversion: 2.1 time: 0.041023 Aug 29 22:58:55.936171 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 538/1110] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:58:55 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 22:58:55.945784 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b9b6695a-0aba-492d-a3a9-5cef0fc18df0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '.version_select at 0x7efc5fb82af0>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:58:56.037766 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b9b6695a-0aba-492d-a3a9-5cef0fc18df0 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429388164" status: 202 len: 0 microversion: 2.1 time: 0.096017 Aug 29 22:58:56.038371 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 573/1111] 10.222.0.52 () {58 vars in 1221 bytes} [Mon Aug 29 22:58:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429388164 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 22:58:57.023147 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-eb6529c4-9ae7-4897-b022-e2a7009f17c3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: .version_select at 0x7efc5fc8e310>, body: {"keypair": {"name": "tempest-keypair-579516863", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL1kT3zKE3WO7TDaIF33tRs0B0XSPOjRY6NEP9orXEWMczLZtFgc6iUudRj9MqGUBDcDqxDeemn9er73N28gXkPatCcxT490+OzhPvRbfBolhcZarp5FkUctNCpmBVIs5g=="}} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:57.039778 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-eb6529c4-9ae7-4897-b022-e2a7009f17c3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:58:57.043615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.quota [None req-eb6529c4-9ae7-4897-b022-e2a7009f17c3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'key_pairs'} {{(pid=139066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:58:57.135569 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-eb6529c4-9ae7-4897-b022-e2a7009f17c3 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.116244 Aug 29 22:58:57.143280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 539/1112] 10.222.0.52 () {60 vars in 1159 bytes} [Mon Aug 29 22:58:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:58:59.512233 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-558811089", "imageRef": "747566dd-197e-46ac-b04f-38aa8ad4360c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c5a5718-95a5-4078-9ca0-1c8c805a3f99"}], "security_groups": [{"name": "tempest-securitygroup--603877814"}], "key_name": "tempest-keypair-579516863", "user_data": "}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:58:59.621378 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] validate_networks() for [('3c5a5718-95a5-4078-9ca0-1c8c805a3f99', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 22:59:00.082224 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 22:59:00.082796 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 22:59:00.083529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 22:59:00.084433 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 22:59:00.084972 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 22:59:00.096134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:00.096691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:00.097262 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:00.098124 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:00.098634 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:00.099158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:00.116209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 22:59:00.120246 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Getting quotas for user f3121e61f02e4869b8214a5caf1b580a and project 77495a957104457c8f0cbee8c01a4536. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 22:59:00.131609 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 22:59:00.134001 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='747566dd-197e-46ac-b04f-38aa8ad4360c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 22:59:00.266285 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d75f3f2c-50d0-45d0-a926-eebcb845b061 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.758682 Aug 29 22:59:00.267213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 574/1113] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 22:58:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 22:59:00.279616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b3e9bca6-89c3-4a43-b8ca-7099a80e6095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:00.280951 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b3e9bca6-89c3-4a43-b8ca-7099a80e6095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:00.372960 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-b3e9bca6-89c3-4a43-b8ca-7099a80e6095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:00.387371 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b3e9bca6-89c3-4a43-b8ca-7099a80e6095 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1240 microversion: 2.1 time: 0.112910 Aug 29 22:59:00.401928 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 540/1114] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:00 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1240 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:01.411352 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:01.412021 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:01.420269 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:01.432484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:01.432484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:01.432484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:01.432484 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:01.433121 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:01.530064 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:01.542827 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c027e623-1c94-4ea3-916d-24dfc649a75e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1244 microversion: 2.1 time: 0.137565 Aug 29 22:59:01.543412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 575/1115] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:01 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1244 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:59:02.563666 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:02.564402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:02.572686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:02.572686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:02.572686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:02.572686 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:02.573164 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:02.573334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:02.650825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:02.660312 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ebc32fcc-ef68-42ba-b934-a6209b8e792c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1292 microversion: 2.1 time: 0.100727 Aug 29 22:59:02.661508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 541/1116] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:02 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:03.682722 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:03.686275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:03.693268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:03.693927 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:03.694357 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:03.695231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:03.695677 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:03.696092 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:03.860893 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:03.868986 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-d75f9d40-20ad-443f-973d-dd11bdef2f98 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1365 microversion: 2.1 time: 0.190162 Aug 29 22:59:03.869553 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 576/1117] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:03 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:04.715025 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-de5e08d3-ab35-45b7-b578-048e32568f9f req-594ad031-6fe4-46b4-af4f-0076e8d79f66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c712ce38-7dcf-4d09-9ff9-2b93c41237b1", "tag": "29e46337-5618-4ab6-b569-f3f4e3728b06"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:59:04.725736 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-de5e08d3-ab35-45b7-b578-048e32568f9f req-594ad031-6fe4-46b4-af4f-0076e8d79f66 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:04.726218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-de5e08d3-ab35-45b7-b578-048e32568f9f req-594ad031-6fe4-46b4-af4f-0076e8d79f66 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:04.726645 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-de5e08d3-ab35-45b7-b578-048e32568f9f req-594ad031-6fe4-46b4-af4f-0076e8d79f66 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:04.741869 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-de5e08d3-ab35-45b7-b578-048e32568f9f req-594ad031-6fe4-46b4-af4f-0076e8d79f66 service nova] Creating event network-changed:29e46337-5618-4ab6-b569-f3f4e3728b06 for instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 on hv-cinder-85426 Aug 29 22:59:04.744208 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-de5e08d3-ab35-45b7-b578-048e32568f9f req-594ad031-6fe4-46b4-af4f-0076e8d79f66 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240884 Aug 29 22:59:04.744845 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 542/1118] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:59:04.890950 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:04.891717 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:04.898213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:04.898686 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:04.899112 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:04.899800 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:04.900242 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:04.900653 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:05.034886 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:05.045084 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-9031525e-c652-4216-8913-8319713b5dc1 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1365 microversion: 2.1 time: 0.157157 Aug 29 22:59:05.047479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 577/1119] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:04 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:06.068292 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:06.069015 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:06.075162 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:06.075637 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:06.076068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:06.076785 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:06.077241 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:06.078239 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:06.301118 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:06.308654 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-2029c304-391a-4b87-94b8-fffae4abd0c7 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1365 microversion: 2.1 time: 0.245121 Aug 29 22:59:06.309253 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 543/1120] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:06 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:07.332402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:07.333680 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:07.341929 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:07.342402 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:07.342860 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:07.344188 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:07.344664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:07.345100 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:07.478159 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:07.480492 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:07.486607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-f0758bf8-81d7-4e30-94ab-5f0981f40f55 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1365 microversion: 2.1 time: 0.160250 Aug 29 22:59:07.487175 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 578/1121] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:07 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 22:59:08.507427 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:08.508045 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:08.514675 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:08.515184 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:08.515655 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:08.516350 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:08.516833 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:08.517263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:08.648527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:08.657166 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7a76c19c-b6bb-41a3-ac13-f345ffec1d8b tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1365 microversion: 2.1 time: 0.153681 Aug 29 22:59:08.657732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 544/1122] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:08 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:09.678162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:09.678802 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:09.686136 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:09.686617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:09.687769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:09.688638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:09.689119 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:09.689638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:09.762585 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-f32cbb20-3862-40d7-b57a-17fed62a7a31 req-c71da8c9-f532-4299-b22c-d27ddb50a368 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c712ce38-7dcf-4d09-9ff9-2b93c41237b1", "name": "network-vif-plugged", "status": "completed", "tag": "29e46337-5618-4ab6-b569-f3f4e3728b06"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:59:09.773877 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f32cbb20-3862-40d7-b57a-17fed62a7a31 req-c71da8c9-f532-4299-b22c-d27ddb50a368 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:09.774363 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f32cbb20-3862-40d7-b57a-17fed62a7a31 req-c71da8c9-f532-4299-b22c-d27ddb50a368 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:09.774792 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-f32cbb20-3862-40d7-b57a-17fed62a7a31 req-c71da8c9-f532-4299-b22c-d27ddb50a368 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:09.786168 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-f32cbb20-3862-40d7-b57a-17fed62a7a31 req-c71da8c9-f532-4299-b22c-d27ddb50a368 service nova] Creating event network-vif-plugged:29e46337-5618-4ab6-b569-f3f4e3728b06 for instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 on hv-cinder-85426 Aug 29 22:59:09.791127 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-f32cbb20-3862-40d7-b57a-17fed62a7a31 req-c71da8c9-f532-4299-b22c-d27ddb50a368 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032830 Aug 29 22:59:09.792107 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 545/1123] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 22:59:09.823791 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:09.831655 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-7fc83eb1-4adb-4394-b8ef-0d611455d916 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1365 microversion: 2.1 time: 0.157342 Aug 29 22:59:09.832226 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 579/1124] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:09 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:10.854772 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:10.855384 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:10.857385 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=6 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:10.863388 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:10.865695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:10.865695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:10.865695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:10.866174 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:10.866609 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:11.000565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:11.008334 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-837872e7-b031-4048-a4ce-b0df7b12e050 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1365 microversion: 2.1 time: 0.157984 Aug 29 22:59:11.009050 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 546/1125] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:10 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:12.030241 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:12.030877 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:12.032741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:12.034083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:12.040531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:12.041045 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:12.041479 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:12.042165 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:12.042617 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:12.043039 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:12.187085 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 22:59:12.196000 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8a2b080a-7958-4c18-b78e-5df982242fc9 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1555 microversion: 2.1 time: 0.169739 Aug 29 22:59:12.196598 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 580/1126] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 22:59:12 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1555 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 22:59:12.218079 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:12.218573 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:12.225228 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:12.225709 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:12.226141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:12.226826 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:12.227307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:12.227732 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:12.314232 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-b5fdb61e-b131-49b2-a3da-642b7fccceed tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100135 Aug 29 22:59:12.316039 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 547/1127] 10.222.0.52 () {58 vars in 1275 bytes} [Mon Aug 29 22:59:12 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:59:13.553932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-b6bcac3f-97e8-49b1-a29a-4b5469f3b2fe req-4008fa3e-c941-442a-9489-4959bce10aab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c712ce38-7dcf-4d09-9ff9-2b93c41237b1", "tag": "29e46337-5618-4ab6-b569-f3f4e3728b06"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:59:13.564290 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-b6bcac3f-97e8-49b1-a29a-4b5469f3b2fe req-4008fa3e-c941-442a-9489-4959bce10aab service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:13.565431 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-b6bcac3f-97e8-49b1-a29a-4b5469f3b2fe req-4008fa3e-c941-442a-9489-4959bce10aab service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:13.565885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-b6bcac3f-97e8-49b1-a29a-4b5469f3b2fe req-4008fa3e-c941-442a-9489-4959bce10aab service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:13.577130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-b6bcac3f-97e8-49b1-a29a-4b5469f3b2fe req-4008fa3e-c941-442a-9489-4959bce10aab service nova] Creating event network-changed:29e46337-5618-4ab6-b569-f3f4e3728b06 for instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 on hv-cinder-85426 Aug 29 22:59:13.582440 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-b6bcac3f-97e8-49b1-a29a-4b5469f3b2fe req-4008fa3e-c941-442a-9489-4959bce10aab service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032166 Aug 29 22:59:13.586036 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 581/1128] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 22:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:59:49.619466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:49.620307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:49.624339 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:49.625064 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:49.630915 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:49.631394 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:49.631829 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:49.632522 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:49.633009 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:49.633467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:49.656542 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-af365ceb-52a5-4eec-92d2-0fb77597441e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039500 Aug 29 22:59:49.657148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 548/1129] 10.222.0.52 () {58 vars in 1248 bytes} [Mon Aug 29 22:59:49 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:59:51.301390 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "054e1822-b1fc-42a4-9293-f46a99976eb7"}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 22:59:51.303610 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:51.306213 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:51.306902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=15 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 22:59:51.311664 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:51.312135 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:51.312558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:51.313268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:51.313712 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:51.314122 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:52.109210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-93de9ddf-5e42-43f4-941f-0fe735979559 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "POST /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.812161 Aug 29 22:59:52.109824 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 582/1130] 10.222.0.52 () {60 vars in 1323 bytes} [Mon Aug 29 22:59:51 2022] POST /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments => generated 194 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 22:59:59.736076 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 22:59:59.736586 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 22:59:59.744341 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:59.744854 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:59.745295 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:59.745988 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 22:59:59.746445 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 22:59:59.746872 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 22:59:59.827267 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lazy-loading 'services' on Instance uuid c712ce38-7dcf-4d09-9ff9-2b93c41237b1 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:00:00.019721 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-68ac4645-7d89-431d-9518-91e26b1b693e tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments/054e1822-b1fc-42a4-9293-f46a99976eb7" status: 202 len: 0 microversion: 2.1 time: 0.287796 Aug 29 23:00:00.020633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 549/1131] 10.222.0.52 () {58 vars in 1416 bytes} [Mon Aug 29 22:59:59 2022] DELETE /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments/054e1822-b1fc-42a4-9293-f46a99976eb7 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 29 23:00:00.030757 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:00.033091 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:00.039848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:00.040328 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:00.040793 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:00.041597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:00.042275 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:00.042700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:00.074748 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0cb73676-af60-4d52-b536-b16b1851da76 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049152 Aug 29 23:00:00.075380 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 583/1132] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 23:00:00 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:00:01.089430 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:01.091796 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:01.098863 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:01.099380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:01.099824 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:01.100527 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:01.101033 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:01.101463 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:01.131196 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-af989c25-a008-45c3-9397-60a82c33215f tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047454 Aug 29 23:00:01.131680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 550/1133] 10.222.0.52 () {58 vars in 1302 bytes} [Mon Aug 29 23:00:01 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 29 23:00:01.194817 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:01.195313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:01.201742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:01.202218 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:01.202648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:01.203445 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:01.203902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:01.204339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:01.231541 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:00:01.556605 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-482c4d14-239e-484f-adc8-77ba85fdb41d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 204 len: 0 microversion: 2.1 time: 0.365251 Aug 29 23:00:01.557279 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 584/1134] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:00:01 2022] DELETE /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:00:01.565747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:01.571409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:01.572232 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:01.573283 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:01.573738 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:01.574533 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:01.574990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:01.575419 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:01.705504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:01.714250 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-6cf5052e-f12a-4c7f-9dfb-10c7cfe77928 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1680 microversion: 2.1 time: 0.151579 Aug 29 23:00:01.714814 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 551/1135] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:01 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:02.735991 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:02.736706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:02.743042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:02.743543 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:02.743965 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:02.745214 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:02.745769 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:02.746290 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:02.879923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:02.887846 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-0c4e02b0-5a61-4fb0-bced-6d35d03fe35c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1680 microversion: 2.1 time: 0.156035 Aug 29 23:00:02.888417 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 585/1136] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:02 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:03.909273 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:03.909912 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:03.916664 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:03.917180 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:03.917611 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:03.918306 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:03.918751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:03.919168 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:04.028299 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:04.035223 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-43c7aca3-a514-4a6e-8c7a-7c644fea54a7 req-1de653cf-1131-46d4-b65c-e2b487cc8ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c712ce38-7dcf-4d09-9ff9-2b93c41237b1", "name": "network-vif-deleted", "tag": "29e46337-5618-4ab6-b569-f3f4e3728b06"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:00:04.037052 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7909cbff-2f8e-46d9-a819-d7510348082d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1613 microversion: 2.1 time: 0.131556 Aug 29 23:00:04.038439 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 552/1137] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:03 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1613 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:04.059237 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-43c7aca3-a514-4a6e-8c7a-7c644fea54a7 req-1de653cf-1131-46d4-b65c-e2b487cc8ae5 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:04.059736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-43c7aca3-a514-4a6e-8c7a-7c644fea54a7 req-1de653cf-1131-46d4-b65c-e2b487cc8ae5 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:04.060157 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-43c7aca3-a514-4a6e-8c7a-7c644fea54a7 req-1de653cf-1131-46d4-b65c-e2b487cc8ae5 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:04.072327 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-43c7aca3-a514-4a6e-8c7a-7c644fea54a7 req-1de653cf-1131-46d4-b65c-e2b487cc8ae5 service nova] Creating event network-vif-deleted:29e46337-5618-4ab6-b569-f3f4e3728b06 for instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 on hv-cinder-85426 Aug 29 23:00:04.078256 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-43c7aca3-a514-4a6e-8c7a-7c644fea54a7 req-1de653cf-1131-46d4-b65c-e2b487cc8ae5 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046624 Aug 29 23:00:04.078856 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 586/1138] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:00:05.059710 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:05.060318 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:05.067479 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:05.067963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:05.068515 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:05.069176 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:05.069624 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:05.070744 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:05.103457 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:05.104450 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:05.104905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:05.105349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lazy-loading 'fault' on Instance uuid c712ce38-7dcf-4d09-9ff9-2b93c41237b1 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:00:05.147579 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3121e61f02e4869b8214a5caf1b580a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77495a957104457c8f0cbee8c01a4536', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:05.154495 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e5b2461d-f6c8-423b-9f3d-9ba18f4df944 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 200 len: 1330 microversion: 2.1 time: 0.099270 Aug 29 23:00:05.155393 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 553/1139] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:05 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 1330 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:06.177330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:06.178023 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:06.184337 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:06.184850 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:06.185292 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:06.186016 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:06.186471 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:06.186892 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:06.200703 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 HTTP/1.1 Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 23:00:06.202326 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:06.203989 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'c712ce38-7dcf-4d09-9ff9-2b93c41237b1'} Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:06.204979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:06.206660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:06.208209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:06.208209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-21613e4e-031f-44f1-a1c4-88ace305a10c tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 404 len: 111 microversion: 2.1 time: 0.031292 Aug 29 23:00:06.208209 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 587/1140] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:06 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:06.213820 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-13d76f2c-1daf-4584-9acb-08708231c058 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '.version_select at 0x7efc5fc8e670>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:06.300433 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-13d76f2c-1daf-4584-9acb-08708231c058 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-579516863" status: 202 len: 0 microversion: 2.1 time: 0.091060 Aug 29 23:00:06.301073 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 554/1141] 10.222.0.52 () {58 vars in 1218 bytes} [Mon Aug 29 23:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-579516863 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 29 23:00:08.327923 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:08.328502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:08.335099 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:08.335577 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:08.336014 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:08.336700 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:08.337178 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:08.337597 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:08.351742 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 HTTP/1.1 Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 23:00:08.353386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.367042 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'c712ce38-7dcf-4d09-9ff9-2b93c41237b1'} Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:08.368502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.371868 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.373756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:08.373756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-30ee428f-9999-4d47-a778-38e60ff47eb2 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 404 len: 111 microversion: 2.1 time: 0.031869 Aug 29 23:00:08.373756 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 588/1142] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:00:08 2022] DELETE /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:08.374141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:08.374141 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: c712ce38-7dcf-4d09-9ff9-2b93c41237b1] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:08.374680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:08.374680 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:08.375135 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:08.375890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:08.376349 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:08.376809 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 HTTP/1.1 Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 23:00:08.405238 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.407395 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'c712ce38-7dcf-4d09-9ff9-2b93c41237b1'} Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:08.408336 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. Aug 29 23:00:08.410128 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:08.411631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance c712ce38-7dcf-4d09-9ff9-2b93c41237b1 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:08.411631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-47a0a3f2-63dd-4e7f-823e-4b78cef06851 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1" status: 404 len: 111 microversion: 2.1 time: 0.034416 Aug 29 23:00:08.411631 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 555/1143] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:08 2022] GET /compute/v2.1/servers/c712ce38-7dcf-4d09-9ff9-2b93c41237b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:12.889792 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:12.890339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:12.897334 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:12.900278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:12.900278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:12.900278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:12.900278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:12.900924 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:12.915620 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 HTTP/1.1 Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 23:00:12.917736 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.919339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'fd0ef09b-16ec-49c7-bbf8-9400efe3e020'} Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:12.920182 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.921741 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.923290 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:12.923290 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-dfa9ae8f-df43-4221-a8ef-42e1e19c808a tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 404 len: 111 microversion: 2.1 time: 0.033157 Aug 29 23:00:12.923290 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 589/1144] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:00:12 2022] DELETE /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 29 23:00:12.927489 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:12.928099 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: fd0ef09b-16ec-49c7-bbf8-9400efe3e020] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:12.935414 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:12.935888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:12.936317 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:12.937029 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:12.937475 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:12.937893 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:12.953130 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 HTTP/1.1 Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 23:00:12.954784 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.956447 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'fd0ef09b-16ec-49c7-bbf8-9400efe3e020'} Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:12.957449 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. Aug 29 23:00:12.959229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.960554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance fd0ef09b-16ec-49c7-bbf8-9400efe3e020 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:12.960554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-a32f8a94-8f7a-4e40-9839-334b175d160d tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020" status: 404 len: 111 microversion: 2.1 time: 0.032464 Aug 29 23:00:12.960554 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 556/1145] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:12 2022] GET /compute/v2.1/servers/fd0ef09b-16ec-49c7-bbf8-9400efe3e020 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:12.966502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:12.966995 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:12.972958 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:12.973435 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:12.973864 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:12.974545 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:12.974987 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:12.975400 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:12.989811 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 HTTP/1.1 Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 23:00:12.991349 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:12.993140 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0'} Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:12.994018 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:12.995556 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:12.997095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:12.997095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-6edc92a9-9dbe-496b-9af8-6d4eeeb3c934 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 404 len: 111 microversion: 2.1 time: 0.030778 Aug 29 23:00:12.997095 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 590/1146] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:00:12 2022] DELETE /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:13.001338 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:13.007062 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:13.007994 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:13.008477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:13.008943 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:13.009651 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:13.010280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:13.010759 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:13.024280 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 HTTP/1.1 Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 23:00:13.026504 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:13.028491 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0'} Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:13.036132 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. Aug 29 23:00:13.038067 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:13.039565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance 21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:13.039565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-7e464a26-cde3-43b9-9cf6-ab21e6463c91 tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0" status: 404 len: 111 microversion: 2.1 time: 0.030330 Aug 29 23:00:13.039565 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 557/1147] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:12 2022] GET /compute/v2.1/servers/21cc6c56-3c44-4dd8-aa7c-2ff04dfac4e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:14.360548 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:14.361197 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:14.367441 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:14.367916 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:14.368339 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:14.369048 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:14.369495 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:14.370134 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:14.383315 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 HTTP/1.1 Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 23:00:14.384867 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.387348 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '90c81fe3-5287-4f9b-8889-2286e532ad68'} Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:14.388412 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.390053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.391607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:14.391607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c52df83e-0e3a-4ba3-a62f-f8a24a664daa tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "DELETE /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 404 len: 111 microversion: 2.1 time: 0.030321 Aug 29 23:00:14.391607 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 591/1148] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:00:14 2022] DELETE /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:14.396548 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:14.397215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] [instance: 90c81fe3-5287-4f9b-8889-2286e532ad68] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:14.404002 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:14.404484 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:14.404967 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:14.405695 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:14.406148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:14.406574 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:14.419944 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] HTTP exception thrown: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Request method failure captured: Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 HTTP/1.1 Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPl1436aOFAeW14O9u3x8d_tn5BwjTpWqGSZTMYVwmeMZPBaTikhCauR8b5FmC05QKyB9riMGurg-GvSJGMSZ2C0abnl_v6qMSjf01nGHyGWDLdvPCrQh-ybf4dLK_7kA-KLIX9lFHnjtgw7fTsQJyLgYamJRC3sl6WpXlLEA9MSV0 Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 23:00:14.421493 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_77495a957104457c8f0cbee8c01a4536"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/77495a957104457c8f0cbee8c01a4536"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 77495a957104457c8f0cbee8c01a4536 Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1498479975 Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: f3121e61f02e4869b8214a5caf1b580a Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-AttachVolumeNegativeTest-1498479975-project Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.423096 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '90c81fe3-5287-4f9b-8889-2286e532ad68'} Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:00:14.424024 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. Aug 29 23:00:14.426442 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:00:14.428018 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] Returning 404 to user: Instance 90c81fe3-5287-4f9b-8889-2286e532ad68 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:00:14.428018 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-0d4927ae-66ee-4ab7-92a6-82c4810577be tempest-AttachVolumeNegativeTest-1498479975 tempest-AttachVolumeNegativeTest-1498479975-project] 10.222.0.52 "GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68" status: 404 len: 111 microversion: 2.1 time: 0.030489 Aug 29 23:00:14.428018 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 558/1149] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:14 2022] GET /compute/v2.1/servers/90c81fe3-5287-4f9b-8889-2286e532ad68 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:00:17.572843 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1938856620", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-766470335", "security_groups": [{"name": "tempest-secgroup-smoke-1435890377"}], "block_device_mapping_v2": [{"uuid": "ca75d7c8-8e3c-4839-9fcc-71980285cebf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2773dfeb-fc93-411d-adc3-1d803860c0cc"}]}} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:00:17.706418 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.network.neutron [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] validate_networks() for [('2773dfeb-fc93-411d-adc3-1d803860c0cc', None, None, None, None, None)] {{(pid=139065) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 29 23:00:18.185537 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Flavor limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 29 23:00:18.188633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Image limits 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 29 23:00:18.188633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Flavor pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 29 23:00:18.188633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Image pref 0:0:0 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 29 23:00:18.188633 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.virt.hardware [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=139065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 29 23:00:18.198682 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:18.199274 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:18.199801 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:18.200531 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:18.201015 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:18.201447 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:18.219706 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for project 98941ac6692045859aa7639192603764. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 29 23:00:18.223691 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.quota [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Getting quotas for user df23a24f4d5948deb641de1cefad1f69 and project 98941ac6692045859aa7639192603764. Resources: {'ram', 'cores', 'instances'} {{(pid=139065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 29 23:00:18.286053 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Going to run 1 instances... {{(pid=139065) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 29 23:00:18.287245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca75d7c8-8e3c-4839-9fcc-71980285cebf',volume_size=None,volume_type=None)] {{(pid=139065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 29 23:00:18.678603 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-64d2c8be-f1dd-4415-bdc9-37a87f480f37 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.109780 Aug 29 23:00:18.681917 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 592/1150] 10.222.0.52 () {60 vars in 1147 bytes} [Mon Aug 29 23:00:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 29 23:00:18.690926 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5c8a5865-d218-41e3-96fd-acc93eb4eb78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:18.691531 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5c8a5865-d218-41e3-96fd-acc93eb4eb78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:18.749941 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5c8a5865-d218-41e3-96fd-acc93eb4eb78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:18.757920 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5c8a5865-d218-41e3-96fd-acc93eb4eb78 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1094 microversion: 2.1 time: 0.070855 Aug 29 23:00:18.758492 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 559/1151] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:18 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:19.780631 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:19.781482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:19.787936 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:19.788416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:19.788881 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:19.789565 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:19.790011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:19.790427 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:19.857857 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:19.866206 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-3272cd27-be21-472f-91fb-3bab9ba4b648 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1144 microversion: 2.1 time: 0.090364 Aug 29 23:00:19.866773 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 593/1152] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:19 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:20.894368 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:20.895543 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:20.903753 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:20.905182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:20.905182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:20.906148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:20.906616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:20.907046 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:20.991850 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:21.000391 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-bfd94108-8a2e-4fa4-8883-3885cd837382 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1200 microversion: 2.1 time: 0.112237 Aug 29 23:00:21.001115 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 560/1153] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:20 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1200 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:22.027526 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:22.028098 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:22.031640 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:22.035841 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:22.036980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:22.037312 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:22.038012 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:22.038465 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:22.039081 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:22.042514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:22.230362 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:22.238965 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-b293bf15-c158-4484-b05f-c5820479ccab tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1278 microversion: 2.1 time: 0.217506 Aug 29 23:00:22.241354 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 594/1154] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:22 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:22.503825 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-7c273452-33b7-417e-8beb-955a1086b4b4 req-f0747245-ba39-438e-a170-417a4b8c2674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b86705a-1c87-4aca-bbff-04ff2295ff69", "tag": "0c23147e-e0b2-4065-a910-d8817047c0ec"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:00:22.516256 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7c273452-33b7-417e-8beb-955a1086b4b4 req-f0747245-ba39-438e-a170-417a4b8c2674 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:22.517063 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7c273452-33b7-417e-8beb-955a1086b4b4 req-f0747245-ba39-438e-a170-417a4b8c2674 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:22.517477 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7c273452-33b7-417e-8beb-955a1086b4b4 req-f0747245-ba39-438e-a170-417a4b8c2674 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:22.529702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-7c273452-33b7-417e-8beb-955a1086b4b4 req-f0747245-ba39-438e-a170-417a4b8c2674 service nova] Creating event network-changed:0c23147e-e0b2-4065-a910-d8817047c0ec for instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 on hv-cinder-85426 Aug 29 23:00:22.536148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-7c273452-33b7-417e-8beb-955a1086b4b4 req-f0747245-ba39-438e-a170-417a4b8c2674 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035186 Aug 29 23:00:22.536148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 561/1155] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:00:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:00:23.261896 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:23.263056 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:23.273212 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:23.276613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:23.276613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:23.276613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:23.276613 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:23.277055 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:23.417196 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:23.424622 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-26094ec2-6123-464a-9b26-e3393884483d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.168542 Aug 29 23:00:23.425207 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 595/1156] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:23 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:24.455901 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:24.456600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:24.463084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:24.464320 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:24.464698 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:24.465946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:24.466441 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:24.466894 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:24.606134 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:24.615243 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-cdceec19-cec9-4955-b9ea-02d237a9f3ac tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.162939 Aug 29 23:00:24.616314 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 562/1157] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:24 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:25.646660 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:25.647272 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:25.655418 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:25.655902 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:25.656335 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:25.657062 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:25.657513 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:25.657933 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:25.799752 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:25.808029 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4439beb1-e117-4e15-b94f-88db69b7e8e1 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.164529 Aug 29 23:00:25.808698 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 596/1158] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:25 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:26.830144 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:26.830702 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:26.837314 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:26.837790 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:26.838218 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:26.838966 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:26.839391 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:26.839802 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:26.972547 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:26.980466 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ee9152e7-808f-47c2-b0df-6b4a6d0494ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.154388 Aug 29 23:00:26.981059 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 563/1159] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:26 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:28.001765 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:28.002365 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:28.008428 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:28.008947 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:28.009372 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:28.010604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:28.011063 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:28.011482 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:28.147870 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:28.157017 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-5a4617c8-c7e0-4682-b782-cd37d1d7a808 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.159451 Aug 29 23:00:28.157596 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 597/1160] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:27 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:00:29.178219 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:29.178833 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:29.181244 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell0:SELECT=2 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:29.186470 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:29.186963 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:29.189751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:29.189751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:29.189751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:29.189751 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:29.340875 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:29.349467 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-ae5e34af-8a8d-405a-8769-f5214c7a282f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.175128 Aug 29 23:00:29.350226 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 564/1161] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:29 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:30.372003 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:30.372615 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:30.374499 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=2 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:30.375164 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell0:SELECT=6 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:30.380330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:30.380853 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:30.381343 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:30.381982 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:30.382432 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:30.382852 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:30.528740 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:30.537419 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-8a5a1fc6-856c-4e78-8ab8-731e0b4b550a tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.169835 Aug 29 23:00:30.537995 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 598/1162] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:30 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:31.559619 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:31.560184 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:31.562598 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:31.567315 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:31.567837 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:31.568276 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:31.569003 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:31.569462 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:31.572643 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:31.574101 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=74,nova_cell1:INSERT=1 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:00:31.711840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:31.719984 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-31742fd3-b964-4180-be2d-71bdb3a0368b tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.164512 Aug 29 23:00:31.720799 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 565/1163] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:31 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:32.259571 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-1c42ec58-4203-42ff-8811-eec848075b39 req-9d096551-4790-478a-9b2e-46284bb2270a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b86705a-1c87-4aca-bbff-04ff2295ff69", "name": "network-vif-plugged", "status": "completed", "tag": "0c23147e-e0b2-4065-a910-d8817047c0ec"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:00:32.268385 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1c42ec58-4203-42ff-8811-eec848075b39 req-9d096551-4790-478a-9b2e-46284bb2270a service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:32.268886 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1c42ec58-4203-42ff-8811-eec848075b39 req-9d096551-4790-478a-9b2e-46284bb2270a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:32.269310 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-1c42ec58-4203-42ff-8811-eec848075b39 req-9d096551-4790-478a-9b2e-46284bb2270a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:32.280962 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-1c42ec58-4203-42ff-8811-eec848075b39 req-9d096551-4790-478a-9b2e-46284bb2270a service nova] Creating event network-vif-plugged:0c23147e-e0b2-4065-a910-d8817047c0ec for instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 on hv-cinder-85426 Aug 29 23:00:32.286118 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-1c42ec58-4203-42ff-8811-eec848075b39 req-9d096551-4790-478a-9b2e-46284bb2270a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172581 Aug 29 23:00:32.286709 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 599/1164] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:00:32.917600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:32.918355 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:32.924178 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:32.924659 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:32.925148 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:32.925840 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:32.926286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:32.926704 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:33.102990 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:33.113305 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-24c65bfe-ddbb-451f-9d01-424c382a5350 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.375855 Aug 29 23:00:33.113890 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 566/1165] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:32 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:34.136521 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:34.137322 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:34.143616 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:34.144192 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:34.144684 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:34.145550 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:34.146065 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:34.146544 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:34.287922 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:34.296330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-ad3af507-d7ae-44ac-b10f-17b1cc6eac93 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1266 microversion: 2.1 time: 0.165231 Aug 29 23:00:34.296928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 600/1166] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:34 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:35.318409 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:35.319008 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:35.326757 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:35.327172 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:35.327600 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:35.328279 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:35.328739 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:35.329162 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:35.468924 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:35.476925 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-5fe1d274-aa9b-4023-9f67-c1c45f2c7832 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1454 microversion: 2.1 time: 0.162300 Aug 29 23:00:35.477498 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 567/1167] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:35 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:00:35.499162 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:00:35.499812 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:00:35.506163 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:35.506645 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:35.507080 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:35.507778 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:35.508228 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:35.508645 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:35.648539 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:00:35.656528 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-37851fff-77fb-402a-ab42-a716b48505a9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1454 microversion: 2.1 time: 0.162041 Aug 29 23:00:35.657202 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 601/1168] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:00:35 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1454 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:00:37.794568 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-7df32c77-506b-4223-8aa2-62f01cae8649 req-58ea7c7e-74fb-49bc-b543-20c30b346d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b86705a-1c87-4aca-bbff-04ff2295ff69", "tag": "0c23147e-e0b2-4065-a910-d8817047c0ec"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:00:37.804182 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7df32c77-506b-4223-8aa2-62f01cae8649 req-58ea7c7e-74fb-49bc-b543-20c30b346d81 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:00:37.804660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7df32c77-506b-4223-8aa2-62f01cae8649 req-58ea7c7e-74fb-49bc-b543-20c30b346d81 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:00:37.805121 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-7df32c77-506b-4223-8aa2-62f01cae8649 req-58ea7c7e-74fb-49bc-b543-20c30b346d81 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:00:37.817739 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-7df32c77-506b-4223-8aa2-62f01cae8649 req-58ea7c7e-74fb-49bc-b543-20c30b346d81 service nova] Creating event network-changed:0c23147e-e0b2-4065-a910-d8817047c0ec for instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 on hv-cinder-85426 Aug 29 23:00:37.822888 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-7df32c77-506b-4223-8aa2-62f01cae8649 req-58ea7c7e-74fb-49bc-b543-20c30b346d81 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165689 Aug 29 23:00:37.823939 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 568/1169] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:02:05.869724 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR oslo.messaging._drivers.impl_rabbit [-] [63a20e5c-6660-4d22-bdb6-751f65f956bf] AMQP server on 10.222.0.52:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 29 23:02:05.870838 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_api:SELECT=15 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:05.871674 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_api:SELECT=7 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:05.872342 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG dbcounter [-] [139065] Writing DB stats nova_cell1:SELECT=43 {{(pid=139065) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:05.872633 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG dbcounter [-] [139066] Writing DB stats nova_cell1:SELECT=19 {{(pid=139066) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 29 23:02:05.874657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 29 23:02:05.874848 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Mon Aug 29 23:02:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 (ip 10.222.0.52) !!! Aug 29 23:02:05.880660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-a2eccc6c-0f46-492c-bf40-23e2d4c4e671 req-933cf130-8585-46d9-8db2-0ff670eaa37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b86705a-1c87-4aca-bbff-04ff2295ff69", "tag": "0c23147e-e0b2-4065-a910-d8817047c0ec"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:02:05.885863 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:05.886452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:05.890747 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a2eccc6c-0f46-492c-bf40-23e2d4c4e671 req-933cf130-8585-46d9-8db2-0ff670eaa37a service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:05.891518 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a2eccc6c-0f46-492c-bf40-23e2d4c4e671 req-933cf130-8585-46d9-8db2-0ff670eaa37a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:05.891947 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-a2eccc6c-0f46-492c-bf40-23e2d4c4e671 req-933cf130-8585-46d9-8db2-0ff670eaa37a service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:05.899130 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:05.899730 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:05.900238 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:05.901046 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:05.901570 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:05.906268 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:05.909214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-a2eccc6c-0f46-492c-bf40-23e2d4c4e671 req-933cf130-8585-46d9-8db2-0ff670eaa37a service nova] Creating event network-changed:0c23147e-e0b2-4065-a910-d8817047c0ec for instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 on hv-cinder-85426 Aug 29 23:02:05.914500 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-a2eccc6c-0f46-492c-bf40-23e2d4c4e671 req-933cf130-8585-46d9-8db2-0ff670eaa37a service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045489 Aug 29 23:02:05.915307 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 569/1170] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:02:05.933111 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Going to try to terminate instance {{(pid=139065) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:02:06.297043 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-09d56a58-b22f-4949-a664-cc10906eb9e9 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "DELETE /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 204 len: 0 microversion: 2.1 time: 0.430239 Aug 29 23:02:06.297899 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 602/1171] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:02:05 2022] DELETE /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:02:06.308786 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:06.310377 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:06.318267 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:06.319112 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:06.319553 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:06.320311 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:06.320856 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:06.321308 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:06.479726 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:06.487648 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-09d168e8-202e-4b7f-8c2c-3e5019d40efe tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1579 microversion: 2.1 time: 0.185357 Aug 29 23:02:06.488237 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 570/1172] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:06 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1579 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:07.509460 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:07.510019 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:07.518511 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:07.518988 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:07.519416 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:07.520105 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:07.520546 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:07.520982 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:07.526529 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO oslo.messaging._drivers.impl_rabbit [-] [63a20e5c-6660-4d22-bdb6-751f65f956bf] Reconnected to AMQP server on 10.222.0.52:5672 via [amqp] client with port 45342. Aug 29 23:02:07.663587 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:07.671502 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c1cd935c-9e34-4689-883a-0cd607799901 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1579 microversion: 2.1 time: 0.166392 Aug 29 23:02:07.672155 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 603/1173] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:07 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:08.546461 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [req-e9a30dd1-458f-4c02-820b-daf74b3de04c req-874b8021-2cf5-4fe2-b4a3-3df34f697f77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b86705a-1c87-4aca-bbff-04ff2295ff69", "name": "network-vif-deleted", "tag": "0c23147e-e0b2-4065-a910-d8817047c0ec"}]} {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:02:08.556264 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e9a30dd1-458f-4c02-820b-daf74b3de04c req-874b8021-2cf5-4fe2-b4a3-3df34f697f77 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:08.558343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e9a30dd1-458f-4c02-820b-daf74b3de04c req-874b8021-2cf5-4fe2-b4a3-3df34f697f77 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:08.558343 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [req-e9a30dd1-458f-4c02-820b-daf74b3de04c req-874b8021-2cf5-4fe2-b4a3-3df34f697f77 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:08.569082 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.compute.server_external_events [req-e9a30dd1-458f-4c02-820b-daf74b3de04c req-874b8021-2cf5-4fe2-b4a3-3df34f697f77 service nova] Creating event network-vif-deleted:0c23147e-e0b2-4065-a910-d8817047c0ec for instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 on hv-cinder-85426 Aug 29 23:02:08.574551 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [req-e9a30dd1-458f-4c02-820b-daf74b3de04c req-874b8021-2cf5-4fe2-b4a3-3df34f697f77 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031799 Aug 29 23:02:08.575147 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 571/1174] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:02:08.695168 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:08.696201 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:08.704604 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:08.705125 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:08.705558 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:08.706257 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:08.706701 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:08.707117 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:08.772980 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:08.781308 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-756b4a75-79a1-495b-bbf7-6f4c28f66638 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1225 microversion: 2.1 time: 0.091057 Aug 29 23:02:08.781897 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 604/1175] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:08 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:09.805589 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:09.806216 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:09.813374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:09.815126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:09.815126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:09.815126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:09.815426 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:09.815812 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:09.851645 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:09.852663 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:09.853264 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:09.853861 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.objects.instance [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lazy-loading 'fault' on Instance uuid 0b86705a-1c87-4aca-bbff-04ff2295ff69 {{(pid=139066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:02:09.900851 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:09.909161 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9ed357c7-6ed7-4c70-87f6-14bbbb5068ed tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 200 len: 1184 microversion: 2.1 time: 0.108476 Aug 29 23:02:09.909752 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 572/1176] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:09 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 1184 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:10.930912 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:10.931514 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 0b86705a-1c87-4aca-bbff-04ff2295ff69] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:10.944158 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:10.944648 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:10.945116 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:10.945842 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:10.946296 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:10.946713 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:10.965148 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] HTTP exception thrown: Instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 could not be found. Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Request method failure captured: Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 HTTP/1.1 Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPbNhF2nx5qJMYcrsnCT9_ppuwiiYpejkzDIVJwY_IDYIBBps0FqhwnFlBpvvOHlxptp1FRies19Fo4zG_47pX0WQlpW-u3sc2Jq0y6WvltkV2z81PRvXT6vYaxXS0ulW-diF0blNlxZLxWODDT1JiL2eAZzJFEk8UO3uHujAsI3qE Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 23:02:10.972321 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_98941ac6692045859aa7639192603764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/98941ac6692045859aa7639192603764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: df23a24f4d5948deb641de1cefad1f69 Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 could not be found. Aug 29 23:02:10.975149 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': '0b86705a-1c87-4aca-bbff-04ff2295ff69'} Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 could not be found. Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:02:10.976820 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 could not be found. Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 could not be found. Aug 29 23:02:10.979437 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:10.983458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Returning 404 to user: Instance 0b86705a-1c87-4aca-bbff-04ff2295ff69 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:02:10.983458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-dc747431-608b-4108-8c8f-2d3551c1fbf7 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69" status: 404 len: 111 microversion: 2.1 time: 0.047051 Aug 29 23:02:10.983458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 605/1177] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:10 2022] GET /compute/v2.1/servers/0b86705a-1c87-4aca-bbff-04ff2295ff69 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:02:14.414493 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-442b64e7-e22c-45ed-a897-243330cf688c req-b385e8b6-5b61-4c9e-a1a0-7cbee007330f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95eb6982-122b-42c2-a914-d42b2a64b8b6", "tag": "ec64c87c-bc7f-4c57-9f3f-1ceeec96166e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:02:14.417383 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:14.418296 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:14.425979 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-442b64e7-e22c-45ed-a897-243330cf688c req-b385e8b6-5b61-4c9e-a1a0-7cbee007330f service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:14.426458 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-442b64e7-e22c-45ed-a897-243330cf688c req-b385e8b6-5b61-4c9e-a1a0-7cbee007330f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:14.426886 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-442b64e7-e22c-45ed-a897-243330cf688c req-b385e8b6-5b61-4c9e-a1a0-7cbee007330f service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:14.429604 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:14.430529 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:14.431374 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:14.432627 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:14.433538 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:14.434273 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:14.442230 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-442b64e7-e22c-45ed-a897-243330cf688c req-b385e8b6-5b61-4c9e-a1a0-7cbee007330f service nova] Creating event network-changed:ec64c87c-bc7f-4c57-9f3f-1ceeec96166e for instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 on hv-cinder-85426 Aug 29 23:02:14.447626 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-442b64e7-e22c-45ed-a897-243330cf688c req-b385e8b6-5b61-4c9e-a1a0-7cbee007330f service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036659 Aug 29 23:02:14.448469 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 606/1178] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 29 23:02:14.485919 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Going to try to terminate instance {{(pid=139066) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 29 23:02:15.090229 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-bf588377-8a40-4d28-9a03-d00cd73fa065 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "DELETE /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 204 len: 0 microversion: 2.1 time: 0.680444 Aug 29 23:02:15.090838 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 573/1179] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:02:14 2022] DELETE /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 29 23:02:15.100330 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:15.104932 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:15.107411 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:15.107952 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:15.108386 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:15.109109 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:15.109552 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:15.110024 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:15.264638 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:15.272697 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-c7eec2ef-6be2-4edc-beb8-36c7361a4e0f tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1577 microversion: 2.1 time: 0.176455 Aug 29 23:02:15.275231 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 607/1180] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:15 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:16.296660 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:16.297402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:16.304670 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:16.305214 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:16.305661 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:16.306402 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:16.306862 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:16.307293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:16.449550 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:16.458047 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-39f629b8-666c-4f00-b934-51bfeeeb15db tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1459 microversion: 2.1 time: 0.166409 Aug 29 23:02:16.459084 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 574/1181] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:16 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1459 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 29 23:02:17.199881 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [req-79c9ea16-414c-49d5-a1a8-5207c97b19bc req-0735a12c-d101-4206-9f7a-facb5bf8eb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95eb6982-122b-42c2-a914-d42b2a64b8b6", "name": "network-vif-deleted", "tag": "ec64c87c-bc7f-4c57-9f3f-1ceeec96166e"}]} {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 29 23:02:17.211184 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-79c9ea16-414c-49d5-a1a8-5207c97b19bc req-0735a12c-d101-4206-9f7a-facb5bf8eb72 service nova] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:17.211657 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-79c9ea16-414c-49d5-a1a8-5207c97b19bc req-0735a12c-d101-4206-9f7a-facb5bf8eb72 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:17.212083 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [req-79c9ea16-414c-49d5-a1a8-5207c97b19bc req-0735a12c-d101-4206-9f7a-facb5bf8eb72 service nova] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:17.224298 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.compute.server_external_events [req-79c9ea16-414c-49d5-a1a8-5207c97b19bc req-0735a12c-d101-4206-9f7a-facb5bf8eb72 service nova] Creating event network-vif-deleted:ec64c87c-bc7f-4c57-9f3f-1ceeec96166e for instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 on hv-cinder-85426 Aug 29 23:02:17.229057 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [req-79c9ea16-414c-49d5-a1a8-5207c97b19bc req-0735a12c-d101-4206-9f7a-facb5bf8eb72 service nova] 10.222.0.52 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032962 Aug 29 23:02:17.229747 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 608/1182] 10.222.0.52 () {64 vars in 1317 bytes} [Mon Aug 29 23:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 29 23:02:17.481552 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:17.487946 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:17.490215 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:17.490849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:17.491286 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:17.491991 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:17.492446 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:17.492897 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:17.561645 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.policy [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139066) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:17.570303 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-4c4cd7aa-6b48-4a33-b57b-45ae45d9162d tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1225 microversion: 2.1 time: 0.094158 Aug 29 23:02:17.570979 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 575/1183] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:17 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:18.594635 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:18.595328 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:18.601590 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:18.602011 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:18.602452 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:18.603128 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:18.603578 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:18.603999 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:18.637245 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:18.637726 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:18.638295 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:18.638745 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.objects.instance [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lazy-loading 'fault' on Instance uuid 95eb6982-122b-42c2-a914-d42b2a64b8b6 {{(pid=139065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 29 23:02:18.681945 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.policy [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df23a24f4d5948deb641de1cefad1f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98941ac6692045859aa7639192603764', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=139065) authorize /opt/stack/nova/nova/policy.py:199}} Aug 29 23:02:18.690455 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-36344d81-46ad-4f61-b12f-87b9d3187448 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 200 len: 1230 microversion: 2.1 time: 0.100629 Aug 29 23:02:18.691030 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 609/1184] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:18 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 1230 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 29 23:02:19.711932 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:19.712588 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: 95eb6982-122b-42c2-a914-d42b2a64b8b6] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:19.719954 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:19.720440 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:19.720914 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:19.721615 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:19.722068 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:19.722494 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:19.736905 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] HTTP exception thrown: Instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 could not be found. Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Request method failure captured: Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 HTTP/1.1 Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPbNhF2nx5qJMYcrsnCT9_ppuwiiYpejkzDIVJwY_IDYIBBps0FqhwnFlBpvvOHlxptp1FRies19Fo4zG_47pX0WQlpW-u3sc2Jq0y6WvltkV2z81PRvXT6vYaxXS0ulW-diF0blNlxZLxWODDT1JiL2eAZzJFEk8UO3uHujAsI3qE Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 23:02:19.741508 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_98941ac6692045859aa7639192603764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/98941ac6692045859aa7639192603764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: df23a24f4d5948deb641de1cefad1f69 Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 could not be found. Aug 29 23:02:19.743345 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': '95eb6982-122b-42c2-a914-d42b2a64b8b6'} Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 could not be found. Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:02:19.744380 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 could not be found. Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 could not be found. Aug 29 23:02:19.746616 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:19.748277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Returning 404 to user: Instance 95eb6982-122b-42c2-a914-d42b2a64b8b6 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:02:19.748277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-e9f9c3db-a455-4cc4-996d-135e52ce8f35 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6" status: 404 len: 111 microversion: 2.1 time: 0.032289 Aug 29 23:02:19.748277 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 576/1185] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:19 2022] GET /compute/v2.1/servers/95eb6982-122b-42c2-a914-d42b2a64b8b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:02:20.610450 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:20.610978 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.compute.api [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139065) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:20.617313 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.617787 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.618210 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.618885 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.619325 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.619739 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG oslo_concurrency.lockutils [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.wsgi [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] HTTP exception thrown: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Request method failure captured: Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: request: DELETE /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 HTTP/1.1 Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept: application/json Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Accept-Encoding: identity Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Connection: close Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Length: 0 Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Content-Type: application/json Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Host: 10.222.0.52 Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: Openstack-System-Scope: None Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: User-Agent: python-urllib3/1.26.12 Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Auth-Token: gAAAAABjDUPbNhF2nx5qJMYcrsnCT9_ppuwiiYpejkzDIVJwY_IDYIBBps0FqhwnFlBpvvOHlxptp1FRies19Fo4zG_47pX0WQlpW-u3sc2Jq0y6WvltkV2z81PRvXT6vYaxXS0ulW-diF0blNlxZLxWODDT1JiL2eAZzJFEk8UO3uHujAsI3qE Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Id: None Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Domain-Name: None Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Identity-Status: Confirmed Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Is-Admin-Project: True Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Id: default Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Domain-Name: Default Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Project-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Role: member,reader Aug 29 23:02:20.643278 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Roles: member,reader Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_98941ac6692045859aa7639192603764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/98941ac6692045859aa7639192603764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-Tenant-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Id: default Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Domain-Name: Default Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Id: df23a24f4d5948deb641de1cefad1f69 Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: X-User-Name: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: method: > Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: exception: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.645174 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: action_args: {'id': 'cc481bca-3e90-4125-bf1a-ba29d4218b17'} Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:02:20.646044 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.647397 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.648823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Returning 404 to user: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. {{(pid=139065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:02:20.648823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-dfdd0254-515b-42af-9501-0ab66de7de3c tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "DELETE /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 404 len: 111 microversion: 2.1 time: 0.030485 Aug 29 23:02:20.648823 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 610/1186] 10.222.0.52 () {58 vars in 1239 bytes} [Mon Aug 29 23:02:20 2022] DELETE /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:02:20.655235 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '>' {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:20.655849 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.compute.api [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] [instance: cc481bca-3e90-4125-bf1a-ba29d4218b17] Fetching instance by UUID {{(pid=139066) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 29 23:02:20.661781 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.662263 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.662696 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.663417 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Acquiring lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 29 23:02:20.663871 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 29 23:02:20.664293 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG oslo_concurrency.lockutils [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Lock "37ab55e6-25c4-43ef-ae71-f79d8c00054c" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=139066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 29 23:02:20.679539 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.wsgi [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] HTTP exception thrown: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Request method failure captured: Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: request: GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 HTTP/1.1 Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept: application/json Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Accept-Encoding: identity Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Connection: close Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Length: 0 Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Content-Type: application/json Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Host: 10.222.0.52 Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: Openstack-System-Scope: None Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: User-Agent: python-urllib3/1.26.12 Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Auth-Token: gAAAAABjDUPbNhF2nx5qJMYcrsnCT9_ppuwiiYpejkzDIVJwY_IDYIBBps0FqhwnFlBpvvOHlxptp1FRies19Fo4zG_47pX0WQlpW-u3sc2Jq0y6WvltkV2z81PRvXT6vYaxXS0ulW-diF0blNlxZLxWODDT1JiL2eAZzJFEk8UO3uHujAsI3qE Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Id: None Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Domain-Name: None Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Identity-Status: Confirmed Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Is-Admin-Project: True Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Id: default Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Domain-Name: Default Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Project-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Role: member,reader Aug 29 23:02:20.681126 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Roles: member,reader Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.52:8080", "publicURL": "http://10.222.0.52:8080/v1/AUTH_98941ac6692045859aa7639192603764"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/compute/v2/98941ac6692045859aa7639192603764"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/volume/v3/98941ac6692045859aa7639192603764"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.52:9696/networking"}]}] Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Id: 98941ac6692045859aa7639192603764 Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-Tenant-Name: tempest-TestVolumeBootPattern-231778945 Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Id: default Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Domain-Name: Default Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Id: df23a24f4d5948deb641de1cefad1f69 Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: X-User-Name: tempest-TestVolumeBootPattern-231778945-project Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: method: > Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: exception: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.682889 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: action_args: {'id': 'cc481bca-3e90-4125-bf1a-ba29d4218b17'} Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: {{(pid=139066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 29 23:02:20.684080 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. Aug 29 23:02:20.685756 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: ERROR nova.api.openstack.wsgi Aug 29 23:02:20.687331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: DEBUG nova.api.openstack.wsgi [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Returning 404 to user: Instance cc481bca-3e90-4125-bf1a-ba29d4218b17 could not be found. {{(pid=139066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 29 23:02:20.687331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: INFO nova.api.openstack.requestlog [None req-9f5389fc-4b8d-4439-ace7-23768c034cd4 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17" status: 404 len: 111 microversion: 2.1 time: 0.032026 Aug 29 23:02:20.687331 dv-cinder-854269-4-iscsi devstack@n-api.service[139066]: [pid: 139066|app: 0|req: 577/1187] 10.222.0.52 () {58 vars in 1236 bytes} [Mon Aug 29 23:02:20 2022] GET /compute/v2.1/servers/cc481bca-3e90-4125-bf1a-ba29d4218b17 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 29 23:02:22.251928 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: DEBUG nova.api.openstack.wsgi [None req-4b1be7a7-2d58-4de6-95cf-1f42f8a12e26 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] Calling method '.version_select at 0x7efc5fc0e790>' {{(pid=139065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 29 23:02:22.389216 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: INFO nova.api.openstack.requestlog [None req-4b1be7a7-2d58-4de6-95cf-1f42f8a12e26 tempest-TestVolumeBootPattern-231778945 tempest-TestVolumeBootPattern-231778945-project] 10.222.0.52 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-766470335" status: 202 len: 0 microversion: 2.1 time: 0.141377 Aug 29 23:02:22.394771 dv-cinder-854269-4-iscsi devstack@n-api.service[139065]: [pid: 139065|app: 0|req: 611/1188] 10.222.0.52 () {58 vars in 1260 bytes} [Mon Aug 29 23:02:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-766470335 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)